00000001:02000400:1.0F:1788482748.630557:0:3294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788482757.004326:0:3497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788482758.004656:0:3559:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1279 MB/s 00000001:01000000:2.0:1788482758.254611:0:3559:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1511 MB/s 00000001:01000000:2.0:1788482758.504142:0:3559:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6375 MB/s 00000020:02000000:2.0:1788482759.385835:0:3588:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_g5b8c505 00000400:02000000:1.0:1788482760.439001:0:3603:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.154@tcp [8/256/0/180] 00008000:02000000:1.0:1788482764.514274:0:3753:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788482825.053265:0:5720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788482840.539510:0:6470:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788482840.539515:0:6470:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788482840.539516:0:6470:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788482840.539641:0:6470:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002ae58714 00000080:02000400:2.0:1788482840.539649:0:6470:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788482840.549838:0:6470:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788482840.549851:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0F:1788482840.549950:0:6470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003e615d3a) 00000020:00000080:0.0:1788482840.549986:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0F:1788482840.634064:0:6470:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788482840.634750:0:6470:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788482840.673370:0:6470:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788482840.673595:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788482840.673603:0:6470:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788482840.679335:0:6470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a052 00000020:01000004:3.0:1788482840.679352:0:6470:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788482840.679358:0:6470:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788482840.679367:0:6470:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002ae58714 from MGS 00000020:01000004:3.0:1788482840.679371:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788482840.679398:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009f2d99ab) 00000020:00000080:3.0:1788482840.679413:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788482840.679525:0:6470:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002ae58714 from MGS, refs=2 00080000:01000000:3.0:1788482840.679531:0:6470:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788482840.679537:0:6470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a060 00000100:00100000:3.0:1788482840.680221:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788482840.680361:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788482840.680368:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788482840.681581:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788482840.681591:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788482840.682823:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482840.683256:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788482840.683265:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788482840.684559:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788482840.684567:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788482840.693565:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788482840.698342:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788482840.701459:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482840.701473:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482840.701475:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482840.701968:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482840.701978:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482840.701980:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482840.702733:0:6470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788482840.709299:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788482840.952367:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2003 MB/s 00000001:01000000:2.0:1788482841.210516:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2166 MB/s 00000001:01000000:3.0:1788482841.464396:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 334 MB/s 00000001:01000000:3.0:1788482841.714412:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 343 MB/s 00010000:00010000:2.0:1788482841.720849:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788482841.733024:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788482841.796503:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788482841.803299:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788482841.803357:0:6470:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788482841.803412:0:6470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788482841.803620:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788482841.803641:0:6470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788482841.804183:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482841.804334:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788482841.804340:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788482841.809357:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788482841.809368:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788482841.826244:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788482841.826284:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788482841.827654:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788482841.827675:0:6470:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.154@tcp' 00000020:01000004:2.0:1788482841.827677:0:6470:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788482841.827725:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.154@tcp (typ=mgc) 00000020:00000080:2.0:1788482841.827746:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.154@tcp (00000000bcb44f5f) 00000020:00000080:2.0:1788482841.827776:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788482841.827903:0:6470:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000afadcdac@MGC192.168.206.154@tcp: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788482841.828067:0:6470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.154@tcp-0 is initialized 00000040:01000000:2.0:1788482841.828072:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788482841.831461:0:6489:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788482841.839056:0:6491:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788482841.839126:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.154@tcp (uuid e0f2a9dc-d80b-4f65-b90d-3174e3881641) 00000020:00000080:1.0:1788482841.839148:0:6470:0:(genops.c:1385:class_connect()) connect: client e0f2a9dc-d80b-4f65-b90d-3174e3881641, cookie 0x1d7ea3d89ea1a06e 00000100:00080000:1.0:1788482841.839158:0:6470:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482841.839162:0:6470:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import 00000000afadcdac using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482841.839213:0:6470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d1258f97 x1875360098549888/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788482841.839239:0:6470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS 00000020:01000004:1.0:1788482841.839256:0:6470:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788482841.839260:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788482841.839279:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000030a9d9f1) 00000020:00000080:1.0:1788482841.839293:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788482841.842035:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d1258f97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3618:1875360098549888:0@lo:250: 00000100:00100000:0.0:1788482841.842145:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.842235:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098549888 00000100:00100000:0.0:1788482841.842243:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098549888 00000100:00100000:0.0:1788482841.842277:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482841.842283:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000409b07f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3618:x1875360098549888:12345-0@lo:250: 00010000:00080000:0.0:1788482841.842307:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e0f2a9dc-d80b-4f65-b90d-3174e3881641@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:0.0:1788482841.842332:0:6486:0:(genops.c:1385:class_connect()) connect: client e0f2a9dc-d80b-4f65-b90d-3174e3881641, cookie 0x1d7ea3d89ea1a07c 00000100:00080000:0.0:1788482841.842470:0:6486:0:(import.c:65:import_set_state_nolock()) 000000001496b21a : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482841.842517:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000409b07f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:3618:x1875360098549888:12345-0@lo:250: Request processed in 232us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.842524:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482841.842565:0:3618:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788482841.842572:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.154@tcp: connect to target with instance 0 00000100:00080000:0.0:1788482841.842579:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788482841.842583:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788482841.842585:0:3618:0:(import.c:65:import_set_state_nolock()) 00000000afadcdac MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788482841.842588:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788482841.842596:0:3618:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788482841.842600:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d1258f97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3618:1875360098549888:0@lo:250: 00000100:00100000:1.0:1788482841.917542:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788482841.917753:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788482841.917759:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788482841.922926:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788482841.923029:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788482841.923622:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788482841.923630:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788482841.924635:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788482841.924827:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788482841.924833:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788482841.925690:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788482841.925697:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788482842.020014:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788482842.020258:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788482842.020265:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788482842.028633:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788482842.028650:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788482842.030986:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482842.031204:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788482842.031209:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788482842.037331:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788482842.037343:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788482842.038610:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482842.038804:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788482842.038809:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788482842.039713:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788482842.039722:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788482842.040608:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788482842.040937:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788482842.040943:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788482842.043745:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788482842.043756:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788482842.109148:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788482842.116059:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788482842.116069:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788482842.118024:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788482842.118037:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788482842.118967:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788482842.118977:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788482842.120049:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788482842.120077:0:6470:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788482842.120084:0:6470:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788482842.120205:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788482842.120237:0:6470:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.154@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788482842.120242:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788482842.120243:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788482842.120245:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482842.120246:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482842.120247:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482842.120248:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482842.120249:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482842.120251:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788482842.120252:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482842.120253:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482842.120254:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482842.120256:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788482842.120258:0:6470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788482842.120260:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788482842.120261:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788482842.120263:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482842.120264:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482842.120265:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482842.120266:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482842.120267:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482842.120268:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788482842.120269:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482842.120270:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482842.120270:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482842.120271:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788482842.120295:0:6470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788482842.120310:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039c8df45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550016:0@lo:253: 00000100:00100000:1.0:1788482842.120380:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482842.120423:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b330eefd going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.122007:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550016 00000100:00100000:2.0:1788482842.122018:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550016 00000100:00100000:2.0:1788482842.122059:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788482842.122067:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b572c031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6470:x1875360098550016:12345-0@lo:253: 20000000:01000000:2.0:1788482842.122144:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788482842.122148:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788482842.124011:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788482842.124125:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788482842.124384:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788482842.125650:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788482842.126016:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788482842.126020:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788482842.126025:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788482842.126027:0:6488:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788482842.126039:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788482842.126198:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482842.126335:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788482842.126347:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788482842.126363:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788482842.126377:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788482842.126390:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788482842.126439:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788482842.126447:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788482842.126459:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788482842.126463:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788482842.126474:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788482842.126488:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788482842.126504:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788482842.126533:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788482842.126560:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788482842.126565:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788482842.126573:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482842.126659:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788482842.126668:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788482842.126684:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788482842.126697:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788482842.126709:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788482842.126716:0:6488:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788482842.126739:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788482842.126746:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788482842.126757:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788482842.126781:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788482842.126793:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788482842.126801:0:6488:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788482842.126821:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788482842.126827:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788482842.126838:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788482842.127628:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788482842.127724:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788482842.127747:0:6488:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788482842.127754:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788482842.129255:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788482842.132601:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788482842.132633:0:6488:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.154@tcp for mdt 20000000:01000000:3.0:1788482842.132635:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:3.0:1788482842.132654:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788482842.132659:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788482842.132671:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788482842.132675:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:3.0:1788482842.132706:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788482842.132714:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788482842.132745:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788482842.132772:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788482842.132803:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788482842.132806:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788482842.132811:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788482842.132919:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788482842.132922:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788482842.133841:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788482842.134136:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788482842.134162:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788482842.134177:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788482842.134188:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788482842.134190:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788482842.138203:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788482842.138443:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788482842.138471:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788482842.138486:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788482842.138499:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788482842.138501:0:6488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788482842.138506:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788482842.138508:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788482842.138513:0:6488:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788482842.138518:0:6488:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788482842.138892:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788482842.139071:0:6488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788482842.150758:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788482842.150803:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788482842.150818:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788482842.150835:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788482842.150865:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150880:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150889:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150895:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150901:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150908:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150929:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068563f0a already unused, calling callback (00000000b50db33e) 00010000:00010000:3.0:1788482842.150933:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150939:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150951:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150957:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.150962:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068563f0a/0x1d7ea3d89ea1a083 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788482842.151001:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788482842.176245:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b572c031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6470:x1875360098550016:12345-0@lo:253: Request processed in 54173us (55859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482842.176264:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482842.176522:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039c8df45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550016:0@lo:253: 10000000:01000000:1.0:1788482842.176536:0:6470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788482842.176551:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788482842.176553:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788482842.176555:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482842.176556:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788482842.176557:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482842.176558:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482842.176560:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482842.176561:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788482842.176563:0:6470:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788482842.176564:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482842.176566:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788482842.176585:0:6470:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002ae58714 from lustre-MDT0000 10000000:01000000:1.0:1788482842.176626:0:6470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788482842.176630:0:6470:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788482842.176634:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a69f45ecd28 10000000:01000000:1.0:1788482842.176638:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788482842.176646:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a69f45ecd28 from 1 10000000:01000000:1.0:1788482842.176649:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788482842.176684:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.176693:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.176702:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482842.176717:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039c8df45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550144:0@lo:101: 00000100:00100000:1.0:1788482842.176752:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482842.176801:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e21b869f going to sleep for 11 seconds 00000100:00100000:3.0:1788482842.176860:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550144 00000100:00100000:3.0:1788482842.176867:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550144 00000100:00100000:3.0:1788482842.176899:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482842.176906:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054598174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6470:x1875360098550144:12345-0@lo:101: 00010000:00010000:3.0:1788482842.176918:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482842.176930:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a08a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.176951:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.176983:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.176991:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9dca45f, rc 0) 00000100:00100000:3.0:1788482842.177037:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054598174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:6470:x1875360098550144:12345-0@lo:101: Request processed in 131us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482842.177043:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788482842.178016:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039c8df45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550144:0@lo:101: 00010000:00010000:1.0:1788482842.178043:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.178067:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482842.178168:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039c8df45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550272:0@lo:501: 00000100:00100000:1.0:1788482842.178206:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482842.178237:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e21b869f going to sleep for 11 seconds 00000100:00100000:3.0:1788482842.178343:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550272 00000100:00100000:3.0:1788482842.178349:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550272 00000100:00100000:3.0:1788482842.178378:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482842.178384:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfeeb165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:6470:x1875360098550272:12345-0@lo:501: 00000100:00100000:3.0:1788482842.178481:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfeeb165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:6470:x1875360098550272:12345-0@lo:501: Request processed in 98us (276us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788482842.178489:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482842.178553:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039c8df45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550272:0@lo:501: 10000000:01000000:2.0:1788482842.178579:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788482842.178600:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178612:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482842.178620:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69d20cc000 10000000:01000000:2.0:1788482842.178624:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788482842.178628:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a69d20cc000 10000000:01000000:2.0:1788482842.178631:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788482842.178634:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a69d20cc000 from 1 10000000:01000000:2.0:1788482842.178636:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788482842.178673:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000dee7335a/0x1d7ea3d89ea1a098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178680:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000dee7335a/0x1d7ea3d89ea1a098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178687:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000dee7335a/0x1d7ea3d89ea1a098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482842.178698:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550400:0@lo:101: 00000100:00100000:2.0:1788482842.178737:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.178773:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550400 00000100:00100000:2.0:1788482842.178777:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550400 00000100:00100000:2.0:1788482842.178798:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482842.178811:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8361a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:6470:x1875360098550400:12345-0@lo:101: 00010000:00010000:2.0:1788482842.178819:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482842.178830:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000168f66e0/0x1d7ea3d89ea1a09f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a098 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178844:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000168f66e0/0x1d7ea3d89ea1a09f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a098 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178852:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000168f66e0/0x1d7ea3d89ea1a09f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a098 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178859:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000168f66e0, rc 0) 00000100:00100000:2.0:1788482842.178883:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8361a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+7:6470:x1875360098550400:12345-0@lo:101: Request processed in 72us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482842.178888:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482842.178916:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fab2eaee going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.178928:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550400:0@lo:101: 00010000:00010000:2.0:1788482842.178936:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000dee7335a/0x1d7ea3d89ea1a098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178943:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000dee7335a/0x1d7ea3d89ea1a098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482842.178952:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788482842.178955:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000dee7335a/0x1d7ea3d89ea1a098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.178959:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000dee7335a/0x1d7ea3d89ea1a098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482842.178973:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788482842.178976:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788482842.178979:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a69d20cc000 10000000:01000000:2.0:1788482842.178981:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788482842.178983:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788482842.178985:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788482842.179008:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.179014:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.179020:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482842.179031:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550528:0@lo:101: 00000100:00100000:2.0:1788482842.179054:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.179073:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550528 00000100:00100000:2.0:1788482842.179076:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550528 00000100:00100000:2.0:1788482842.179091:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482842.179130:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5d6b70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+7:6470:x1875360098550528:12345-0@lo:101: 00010000:00010000:2.0:1788482842.179136:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482842.179142:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a0a6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.179154:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.179170:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.179176:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa8d2f86, rc 0) 00000100:00100000:2.0:1788482842.179198:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5d6b70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+8:6470:x1875360098550528:12345-0@lo:101: Request processed in 102us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482842.179204:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482842.179236:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fab2eaee going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.179247:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550528:0@lo:101: 00010000:00010000:2.0:1788482842.179255:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.179261:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482842.179299:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550656:0@lo:501: 00000100:00100000:2.0:1788482842.179321:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.179340:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550656 00000100:00100000:2.0:1788482842.179343:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550656 00000100:00100000:2.0:1788482842.179358:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788482842.179363:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000946260fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+8:6470:x1875360098550656:12345-0@lo:501: 00000100:00100000:2.0:1788482842.179447:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000946260fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6470:x1875360098550656:12345-0@lo:501: Request processed in 83us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482842.179453:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788482842.179475:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fab2eaee going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.179488:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550656:0@lo:501: 00000100:00100000:2.0:1788482842.179517:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550784:0@lo:503: 00000100:00100000:2.0:1788482842.179555:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.179573:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550784 00000100:00100000:2.0:1788482842.179577:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550784 00000100:00100000:2.0:1788482842.179592:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788482842.179597:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0bb2aa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6470:x1875360098550784:12345-0@lo:503: 00000100:00100000:2.0:1788482842.179661:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0bb2aa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6470:x1875360098550784:12345-0@lo:503: Request processed in 64us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482842.179668:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788482842.179697:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fab2eaee going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.179709:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098550784:0@lo:503: 00000100:00100000:3.0:1788482842.180930:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000636acc74 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6515:1875360098550912:0@lo:502: 00000100:00100000:3.0:1788482842.181012:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482842.181052:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e13c142 going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.181234:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098550912 00000100:00100000:2.0:1788482842.181240:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098550912 00000100:00100000:2.0:1788482842.181279:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788482842.181286:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a9ac5cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6515:x1875360098550912:12345-0@lo:502: 00000100:00100000:2.0:1788482842.181382:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a9ac5cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6515:x1875360098550912:12345-0@lo:502: Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482842.181391:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788482842.181508:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000636acc74 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6515:1875360098550912:0@lo:502: 00000020:01000000:1.0:1788482842.181534:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482842.181546:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482842.181548:0:6515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788482842.181552:0:6515:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788482842.181556:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788482842.181568:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006f01aa36) 00000020:00000080:1.0:1788482842.181586:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788482842.181592:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788482842.181683:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788482842.181691:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a0bb 00000020:00000080:1.0:1788482842.181900:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788482842.181904:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482842.181908:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482842.181909:0:6515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788482842.181911:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482842.181915:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482842.181916:0:6515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788482842.181920:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788482842.181928:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000071e64916) 00000020:00000080:1.0:1788482842.181937:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788482842.181940:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788482842.181942:0:6515:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788482842.181950:0:6515:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788482842.181957:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788482842.182032:0:6515:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002ae58714 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788482842.182399:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f992d3d9) 00000020:00000080:1.0:1788482842.182407:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788482842.182489:0:6515:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788482842.182496:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1a0d0 00000020:00000080:1.0:1788482842.182598:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788482842.186766:0:6515:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788482842.186800:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1d7ea3d89ea1a0d7 00080000:01000000:1.0:1788482842.186812:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788482842.186818:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a0de 00080000:10000000:1.0:1788482842.187798:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788482842.187949:0:6515:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788482842.197475:0:6515:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788482842.327449:0:6515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788482842.327783:0:6515:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788482842.332471:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788482842.332822:0:6515:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788482842.338008:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004fbe614d) 00000020:00000080:2.0:1788482842.338029:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788482842.340158:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788482842.340173:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a0ec 00000020:00000080:3.0:1788482842.354748:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788482842.355600:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788482842.359978:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788482842.365379:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788482842.371488:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788482842.379499:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788482842.386684:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788482842.390575:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1d7ea3d89ea1a0f3 00000020:00000080:2.0:1788482842.391260:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788482842.391271:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482842.391277:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482842.391279:0:6515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788482842.391283:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482842.391287:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482842.391288:0:6515:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788482842.391291:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788482842.391292:0:6515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788482842.391295:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482842.391297:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482842.391298:0:6515:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788482842.391300:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482842.391304:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482842.391306:0:6515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788482842.391309:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788482842.391344:0:6515:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788482842.391394:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6515:1875360098551040:0@lo:502: 00000100:00100000:2.0:1788482842.391461:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.391558:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efdf7319 going to sleep for 11 seconds 00000100:00100000:1.0:1788482842.391742:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551040 00000100:00100000:1.0:1788482842.391750:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551040 00000100:00100000:1.0:1788482842.391831:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788482842.391841:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd1c8e86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6515:x1875360098551040:12345-0@lo:502: 00000100:00100000:1.0:1788482842.391958:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd1c8e86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6515:x1875360098551040:12345-0@lo:502: Request processed in 119us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482842.392085:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036ad4e12 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6515:1875360098551040:0@lo:502: 00000020:01000000:3.0:1788482842.392152:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482842.392165:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482842.392166:0:6515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788482842.392171:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788482842.392591:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788482842.392617:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788482842.392635:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482842.392646:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482842.392653:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69d20cc000 from 1 10000000:01000000:0.0:1788482842.392656:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788482842.392698:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482842.392705:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482842.392713:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482842.392727:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000184cd4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551168:0@lo:101: 00000100:00100000:0.0:1788482842.392764:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482842.396168:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788482842.396985:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d723394f going to sleep for 11 seconds 00000100:00100000:1.0:1788482842.397702:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551168 00000100:00100000:1.0:1788482842.397711:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551168 00000100:00100000:1.0:1788482842.397743:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788482842.397749:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009df62178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:6470:x1875360098551168:12345-0@lo:101: 00010000:00010000:1.0:1788482842.397763:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482842.397782:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a0fa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.397820:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.397829:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.397836:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbebde4c, rc 0) 00000100:00100000:1.0:1788482842.397887:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009df62178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:6470:x1875360098551168:12345-0@lo:101: Request processed in 138us (5122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482842.397893:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788482842.398010:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000184cd4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551168:0@lo:101: 00010000:00010000:0.0:1788482842.398025:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482842.398212:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482842.398753:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000184cd4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551296:0@lo:256: 00000100:00100000:0.0:1788482842.398801:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482842.398898:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d723394f going to sleep for 11 seconds 00000100:00100000:3.0:1788482842.398980:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551296 00000100:00100000:3.0:1788482842.398987:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551296 00000100:00100000:0.0:1788482842.399464:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788482842.399475:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000796ea312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:6470:x1875360098551296:12345-0@lo:256: 20000000:01000000:0.0:1788482842.399493:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788482842.399498:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788482842.399576:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000796ea312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:6470:x1875360098551296:12345-0@lo:256: Request processed in 104us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482842.399583:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788482842.399717:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000184cd4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551296:0@lo:256: 10000000:01000000:2.0:1788482842.400321:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788482842.400344:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.400354:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482842.400362:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d20cc000 from 1 10000000:01000000:2.0:1788482842.400364:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482842.400392:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.400408:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.400416:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482842.400433:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551424:0@lo:101: 00000100:00100000:2.0:1788482842.400473:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.400498:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c501a8a6 going to sleep for 11 seconds 00000100:00100000:1.0:1788482842.400703:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551424 00000100:00100000:1.0:1788482842.400710:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551424 00000100:00100000:1.0:1788482842.400737:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482842.400743:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9890832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:6470:x1875360098551424:12345-0@lo:101: 00010000:00010000:1.0:1788482842.400753:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482842.400764:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a108 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.400782:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.400790:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.400798:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa0eab9e, rc 0) 00000100:00100000:1.0:1788482842.400837:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9890832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:6470:x1875360098551424:12345-0@lo:101: Request processed in 93us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482842.400843:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788482842.401469:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551424:0@lo:101: 00010000:00010000:2.0:1788482842.401484:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.401493:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482842.401551:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551552:0@lo:501: 00000100:00100000:2.0:1788482842.401580:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.401612:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c501a8a6 going to sleep for 11 seconds 00000100:00100000:1.0:1788482842.401673:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551552 00000100:00100000:1.0:1788482842.401678:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551552 00000100:00100000:1.0:1788482842.401698:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482842.401703:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013098583 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:6470:x1875360098551552:12345-0@lo:501: 00000100:00100000:1.0:1788482842.401847:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013098583 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:6470:x1875360098551552:12345-0@lo:501: Request processed in 144us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482842.401855:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482842.401948:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551552:0@lo:501: 00000100:00100000:2.0:1788482842.401986:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551680:0@lo:503: 00000100:00100000:2.0:1788482842.402285:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.402300:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c501a8a6 going to sleep for 11 seconds 00000100:00100000:1.0:1788482842.402347:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551680 00000100:00100000:1.0:1788482842.402352:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551680 00000100:00100000:1.0:1788482842.402372:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788482842.402377:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d6388c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:6470:x1875360098551680:12345-0@lo:503: 00000040:00080000:1.0:1788482842.402407:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788482842.402451:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d6388c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:6470:x1875360098551680:12345-0@lo:503: Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482842.402458:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788482842.402534:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551680:0@lo:503: 00000040:00080000:2.0:1788482842.403738:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788482842.404407:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788482842.404429:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482842.404476:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.404488:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482842.404587:0:6470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788482842.404591:0:6470:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69d20cc000 10000000:01000000:3.0:1788482842.404594:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69d20cc000 10000000:01000000:3.0:1788482842.404598:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788482842.404603:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69d20cc000 from 1 10000000:01000000:3.0:1788482842.404605:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788482842.404651:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.404659:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.404667:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482842.404686:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084cfdef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551808:0@lo:101: 00000100:00100000:3.0:1788482842.404740:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482842.410921:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 000000006235c8fe going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.411060:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551808 00000100:00100000:2.0:1788482842.411070:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551808 00000100:00100000:3.0:1788482842.411548:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482842.411559:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000365d51e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:6470:x1875360098551808:12345-0@lo:101: 00010000:00010000:3.0:1788482842.411575:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482842.411591:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a116 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.411618:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.411645:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482842.411653:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f280c7c, rc 0) 00000100:00100000:3.0:1788482842.411719:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000365d51e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6470:x1875360098551808:12345-0@lo:101: Request processed in 163us (6979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482842.411726:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788482842.411809:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084cfdef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551808:0@lo:101: 00010000:00010000:0.0:1788482842.411826:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482842.411835:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482842.411901:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5518225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551936:0@lo:501: 00000100:00100000:0.0:1788482842.411934:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482842.411973:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f656872 going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.412239:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098551936 00000100:00100000:2.0:1788482842.412245:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098551936 00000100:00100000:2.0:1788482842.412281:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788482842.412288:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9223654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6470:x1875360098551936:12345-0@lo:501: 00000100:00100000:2.0:1788482842.412395:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9223654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6470:x1875360098551936:12345-0@lo:501: Request processed in 108us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482842.412403:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788482842.412477:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5518225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098551936:0@lo:501: 00000100:00100000:0.0:1788482842.412505:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5518225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098552064:0@lo:503: 00000100:00100000:0.0:1788482842.412546:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482842.412571:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f656872 going to sleep for 11 seconds 00000100:00100000:0.0:1788482842.412585:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552064 00000100:00100000:0.0:1788482842.412594:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552064 00000100:00100000:0.0:1788482842.412614:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788482842.412619:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002406073d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6470:x1875360098552064:12345-0@lo:503: 00000100:00100000:0.0:1788482842.412693:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002406073d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6470:x1875360098552064:12345-0@lo:503: Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482842.412700:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788482842.412731:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5518225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098552064:0@lo:503: 00000100:00100000:2.0:1788482842.413375:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6521:1875360098552192:0@lo:502: 00000100:00100000:2.0:1788482842.413415:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482842.413446:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4bb44a3 going to sleep for 11 seconds 00000100:00100000:0.0:1788482842.413494:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552192 00000100:00100000:0.0:1788482842.413498:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552192 00000100:00100000:0.0:1788482842.413529:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788482842.413534:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4a4a8cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6521:x1875360098552192:12345-0@lo:502: 00000100:00100000:0.0:1788482842.413613:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4a4a8cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6521:x1875360098552192:12345-0@lo:502: Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482842.413620:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788482842.413726:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cd57c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6521:1875360098552192:0@lo:502: 00000020:01000004:3.0:1788482842.413780:0:6521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788482842.413794:0:6521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b23409f6) 00000020:00000080:3.0:1788482842.413811:0:6521:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788482842.413883:0:6521:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002ae58714 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788482842.413886:0:6521:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002ae58714 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788482842.413889:0:6521:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002ae58714 4 00010000:00080000:3.0:1788482842.413923:0:6521:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004234a97d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:3.0:1788482842.416672:0:6521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788482842.416925:0:6521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788482842.416983:0:6521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788482842.417005:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1d7ea3d89ea1a12b 00000100:00080000:3.0:1788482842.417015:0:6521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788482842.417019:0:6521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004234a97d using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788482842.417066:0:6521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000294dfe29 x1875360098552320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788482842.417244:0:6521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788482842.417499:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000294dfe29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098552320:0@lo:38: 00000100:00100000:0.0:1788482842.417568:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482842.417943:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552320 00000100:00100000:3.0:1788482842.417951:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552320 00000100:00100000:3.0:1788482842.418010:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482842.418016:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5518225 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098552320:12345-0@lo:38: 00000100:00100000:3.0:1788482842.418321:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5518225 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098552320:12345-0@lo:38: Request processed in 303us (752us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788482842.418329:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482842.418402:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788482842.418409:0:3618:0:(import.c:65:import_set_state_nolock()) 000000004234a97d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788482842.418413:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788482842.418416:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000294dfe29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098552320:0@lo:38: 00000100:00100000:3.0:1788482842.418613:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad748ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6521:1875360098552448:0@lo:502: 00000100:00100000:3.0:1788482842.418654:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482842.418684:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 000000001918c620 going to sleep for 11 seconds 00000100:00100000:0.0:1788482842.418736:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552448 00000100:00100000:0.0:1788482842.418740:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552448 00000100:00100000:0.0:1788482842.418777:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788482842.418783:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049c25cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6521:x1875360098552448:12345-0@lo:502: 00000100:00100000:0.0:1788482842.418879:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049c25cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6521:x1875360098552448:12345-0@lo:502: Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482842.418894:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482842.418986:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad748ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6521:1875360098552448:0@lo:502: 00000040:00080000:3.0:1788482842.419017:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788482842.419398:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788482842.419416:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788482842.419434:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482842.419444:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788482842.419486:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788482842.419489:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788482842.419490:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788482842.419491:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788482842.419493:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788482842.419494:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788482842.419495:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788482842.419496:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788482842.419498:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788482842.419499:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788482842.419501:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788482842.419502:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788482842.419505:0:6470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788482842.419507:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788482842.419509:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788482842.419510:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788482842.419511:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788482842.419512:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788482842.419513:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788482842.419514:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788482842.419515:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788482842.419516:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788482842.419517:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788482842.419518:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788482842.419518:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788482842.419534:0:6470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788482842.419544:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bb9730b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098552576:0@lo:253: 00000100:00100000:0.0:1788482842.419583:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482842.419607:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012e3e822 going to sleep for 11 seconds 00000100:00100000:2.0:1788482842.422884:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552576 00000100:00100000:2.0:1788482842.422899:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552576 00000100:00100000:2.0:1788482842.422952:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788482842.423294:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076a2ebcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6470:x1875360098552576:12345-0@lo:253: 20000000:01000000:2.0:1788482842.423347:0:6487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788482842.423361:0:6487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788482842.445404:0:6487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788482842.445430:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788482842.445591:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788482842.445597:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788482842.445617:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.445635:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.445656:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.445691:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482842.445706:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 12 pid: 6487 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482842.445721:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1f6b964 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098552704:0@lo:104: 00000100:00100000:1.0:1788482842.445781:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482842.445845:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b330eefd going to sleep for 11 seconds 00000100:00100000:0.0:1788482842.445906:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552704 00000100:00100000:0.0:1788482842.445914:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552704 00000100:00100000:0.0:1788482842.445962:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482842.445970:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000651cc23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098552704:12345-0@lo:104: 00010000:00010000:0.0:1788482842.445981:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482842.446060:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482842.446065:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000651cc23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098552704:12345-0@lo:104: Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482842.446071:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788482842.446514:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482842.446520:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.446528:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0cc5880 already unused, calling callback (0000000022af2b97) 10000000:00010000:2.0:1788482842.446530:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.446538:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482842.446552:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482842.446557:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482842.446585:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.446591:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482842.446604:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.446609:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 00000000c0cc5880/0x1d7ea3d89ea1a0fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a101 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.446624:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482842.446626:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482842.446627:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482842.446650:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1f6b964 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098552704:0@lo:104: 00010000:00010000:2.0:1788482842.446669:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482842.447462:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482842.447476:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063de309c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098552832:0@lo:103: 00000100:00100000:1.0:1788482842.447519:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482842.447609:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076a2ebcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6470:x1875360098552576:12345-0@lo:253: Request processed in 24649us (28024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482842.447618:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788482842.448743:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552832 00000100:00100000:2.0:1788482842.448754:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552832 00010000:00010000:2.0:1788482842.448784:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 12 pid: 6487 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482842.448814:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482842.448821:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000836cf040 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3619:x1875360098552832:12345-0@lo:103: 00010000:00010000:2.0:1788482842.448833:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482842.448849:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 12 pid: 6487 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448860:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 12 pid: 6487 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448875:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0fa expref: 12 pid: 6487 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448891:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448898:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788482842.448912:0:6478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003316239s 00010000:00010000:2.0:1788482842.448916:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448921:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448926:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448932:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448937:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afc6f436 already unused, calling callback (00000000b50db33e) 00010000:00010000:2.0:1788482842.448940:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448947:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.448980:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.449001:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482842.449062:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000836cf040 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:3619:x1875360098552832:12345-0@lo:103: Request processed in 242us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482842.449070:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788482842.449120:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.449128:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482842.449132:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000afc6f436/0x1d7ea3d89ea1a132 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482842.449169:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063de309c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098552832:0@lo:103: 00000100:00100000:0.0:1788482842.449418:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bb9730b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6470:1875360098552576:0@lo:253: 10000000:01000000:0.0:1788482842.449429:0:6470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788482842.449432:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788482842.449434:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788482842.449435:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788482842.449436:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788482842.449437:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788482842.449438:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788482842.449440:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788482842.449441:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788482842.449443:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788482842.449444:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788482842.449445:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788482842.449447:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788482842.449457:0:6470:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788482842.459316:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788482842.459504:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788482842.459736:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788482842.459905:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788482842.465181:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788482842.465467:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788482842.467584:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788482842.467783:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788482842.468000:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788482842.468190:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788482842.468389:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788482842.468536:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788482842.478004:0:6470:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788482842.496279:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788482842.496360:0:6526:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788482842.496364:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788482842.500624:0:6527:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:0.0:1788482842.504766:0:6527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482842.508881:0:6527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788482842.508952:0:6527:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788482842.508957:0:6527:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788482842.511279:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788482842.511395:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788482842.511832:0:6470:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788482842.511840:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788482842.511939:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788482842.513595:0:6470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788482842.514432:0:6470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788482842.514476:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788482842.514672:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788482842.515289:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788482842.515935:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788482842.516366:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788482842.516527:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788482842.516662:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788482842.516810:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788482842.516937:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788482842.517416:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788482842.517545:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788482842.517687:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788482842.517827:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788482842.518058:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788482842.518389:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788482842.518529:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788482842.518666:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788482842.518824:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788482842.519062:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788482842.519535:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788482842.519710:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788482842.519845:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788482842.520079:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788482842.520421:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788482842.520562:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788482842.520712:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788482842.520853:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788482842.521075:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788482842.521519:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788482842.521658:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788482842.521808:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788482842.521941:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788482842.522615:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788482842.522778:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788482842.522912:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788482842.528562:0:6470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788482842.536869:0:6470:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788482842.536907:0:6470:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb53841cdf988 00100000:10000000:2.0:1788482842.536914:0:6470:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788482842.541943:0:6470:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788482842.541959:0:6470:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788482842.542058:0:6470:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788482842.542074:0:6470:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788482842.543002:0:6470:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482842.543215:0:6470:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788482842.748276:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482843.776559:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482844.793757:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482845.820712:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482846.843667:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788482847.480940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788482847.480949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788482847.480952:0:36:0:(import.c:65:import_set_state_nolock()) 000000004234a97d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788482847.480975:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004234a97d using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788482847.480997:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a66bc675 x1875360098553088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788482847.481030:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a66bc675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098553088:0@lo:38: 00000100:00100000:3.0:1788482847.481121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.481303:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad748ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098552960:0@lo:400: 00000100:00100000:1.0:1788482847.481346:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.481441:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098552960 00000100:00100000:3.0:1788482847.481449:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098552960 00000100:00100000:3.0:1788482847.481499:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482847.481509:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b77c7a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:3621:x1875360098552960:12345-0@lo:400: 00000100:00100000:3.0:1788482847.481560:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b77c7a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:3621:x1875360098552960:12345-0@lo:400: Request processed in 53us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.481567:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482847.481638:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad748ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098552960:0@lo:400: 00000100:00100000:2.0:1788482847.484795:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553088 00000100:00100000:2.0:1788482847.484810:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553088 00000100:00100000:2.0:1788482847.484858:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788482847.484865:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042b99ad2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1875360098553088:12345-0@lo:38: 00010000:00080000:2.0:1788482847.484892:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:2.0:1788482847.484926:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1d7ea3d89ea1a139 00000004:00100000:2.0:1788482847.484980:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788482847.485121:0:6495:0:(import.c:65:import_set_state_nolock()) 000000006a50634c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788482847.485205:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042b99ad2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875360098553088:12345-0@lo:38: Request processed in 340us (4111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.485224:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788482847.485339:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a66bc675 x1875360098553088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788482847.485355:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788482847.485362:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788482847.485367:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788482847.485369:0:3618:0:(import.c:65:import_set_state_nolock()) 000000004234a97d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482847.485375:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a66bc675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098553088:0@lo:38: 00000001:02000400:3.0:1788482847.679316:0:6771:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788482847.867705:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788482848.885704:0:6823:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482848.886051:0:6823:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788482848.893624:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482849.912295:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788482850.557024:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788482850.557034:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69d20cc000 from 3 10000000:01000000:3.0:1788482850.557039:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788482850.557090:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482850.557135:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482850.557146:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482850.557170:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a66bc675 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098553216:0@lo:101: 00000100:00100000:3.0:1788482850.557235:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482850.560346:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a7ffdaa going to sleep for 11 seconds 00000100:00100000:1.0:1788482850.600405:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553216 00000100:00100000:1.0:1788482850.600422:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553216 00000100:00100000:1.0:1788482850.600497:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788482850.600506:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b96cd13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:6491:x1875360098553216:12345-0@lo:101: 00010000:00010000:1.0:1788482850.600524:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482850.600542:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a140 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482850.600568:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482850.600578:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482850.600585:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037f8d93a, rc 0) 00000100:00100000:1.0:1788482850.600672:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b96cd13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6491:x1875360098553216:12345-0@lo:101: Request processed in 167us (43438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482850.600679:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788482850.600893:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a66bc675 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098553216:0@lo:101: 00010000:00010000:0.0:1788482850.600912:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482850.600920:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482850.601004:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bb9730b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098553344:0@lo:256: 00000100:00100000:0.0:1788482850.601047:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482850.601123:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 000000005a3fc133 going to sleep for 11 seconds 00000100:00100000:3.0:1788482850.601385:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553344 00000100:00100000:3.0:1788482850.601390:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553344 00000100:00100000:3.0:1788482850.601429:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482850.601437:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005af7fe32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6491:x1875360098553344:12345-0@lo:256: 20000000:01000000:3.0:1788482850.601458:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788482850.601481:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788482850.601484:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788482850.601566:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005af7fe32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:6491:x1875360098553344:12345-0@lo:256: Request processed in 130us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482850.601573:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788482850.601731:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bb9730b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098553344:0@lo:256: 10000000:01000000:0.0:1788482850.601774:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788482850.601780:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482850.601788:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482850.945281:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482851.966122:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482852.601323:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb94f343 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098553600:0@lo:400: 00000100:00100000:3.0:1788482852.601386:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482852.601452:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553600 00000100:00100000:3.0:1788482852.601459:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553600 00000100:00100000:3.0:1788482852.601499:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482852.601507:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f0898a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098553600:12345-0@lo:400: 00000100:00100000:3.0:1788482852.601554:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f0898a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098553600:12345-0@lo:400: Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482852.601560:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788482852.601608:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fb94f343 x1875360098553600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482852.601629:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb94f343 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098553600:0@lo:400: 00000100:00100000:1.0:1788482852.601676:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad748ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098553472:0@lo:400: 00000100:00100000:1.0:1788482852.601710:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482852.602008:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553472 00000100:00100000:3.0:1788482852.602012:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553472 00000100:00100000:3.0:1788482852.602045:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788482852.602052:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ccd29dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3622:x1875360098553472:12345-0@lo:400: 00000100:00100000:3.0:1788482852.602091:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ccd29dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3622:x1875360098553472:12345-0@lo:400: Request processed in 40us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482852.602119:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788482852.602204:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad748ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098553472:0@lo:400: 00000020:00000004:2.0:1788482852.645349:0:6925:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482852.645568:0:6925:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788482852.986862:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482854.014913:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482855.032320:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482856.059284:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482857.085261:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482857.721988:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bb9730b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098553728:0@lo:400: 00000100:00100000:3.0:1788482857.722055:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482857.722281:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000881bebe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098553856:0@lo:400: 00000100:00100000:3.0:1788482857.722313:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482857.722487:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553856 00000100:00100000:0.0:1788482857.722494:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553856 00000100:00100000:0.0:1788482857.722541:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482857.722549:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb94f343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098553856:12345-0@lo:400: 00000100:00100000:0.0:1788482857.722604:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb94f343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098553856:12345-0@lo:400: Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482857.722611:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482857.722692:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553728 00000100:00100000:1.0:1788482857.722707:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553728 00010000:00080000:2.0:1788482857.722773:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000881bebe6 x1875360098553856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482857.722787:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482857.722791:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000881bebe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098553856:0@lo:400: 00000100:00100000:1.0:1788482857.722864:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a63b46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3620:x1875360098553728:12345-0@lo:400: 00000100:00100000:1.0:1788482857.723074:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a63b46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3620:x1875360098553728:12345-0@lo:400: Request processed in 215us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482857.723121:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788482857.723145:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bb9730b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098553728:0@lo:400: 00010000:00010000:2.0:1788482858.108395:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482859.129116:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482860.156850:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482861.176438:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482862.200352:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482862.849345:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482862.849366:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c386002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098553984:0@lo:400: 00000100:00100000:3.0:1788482862.849534:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482862.849594:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098554112:0@lo:400: 00000100:00100000:3.0:1788482862.849621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482862.849654:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098554112 00000100:00100000:3.0:1788482862.849661:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098554112 00000100:00100000:3.0:1788482862.849702:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482862.849709:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c87d8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098554112:12345-0@lo:400: 00000100:00100000:3.0:1788482862.849753:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c87d8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098554112:12345-0@lo:400: Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482862.849760:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788482862.849796:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003bf771b0 x1875360098554112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482862.849809:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098554112:0@lo:400: 00000100:00100000:1.0:1788482862.849964:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098553984 00000100:00100000:1.0:1788482862.849969:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098553984 00000100:00100000:1.0:1788482862.849998:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788482862.850002:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002a83ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3621:x1875360098553984:12345-0@lo:400: 00000100:00100000:1.0:1788482862.850038:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002a83ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3621:x1875360098553984:12345-0@lo:400: Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482862.850043:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788482862.850073:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c386002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098553984:0@lo:400: 00010000:00010000:3.0:1788482863.225261:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788482863.838748:0:7423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788482863.838754:0:7423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788482863.838756:0:7423:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788482863.839168:0:7423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e5fcb3b1 00000020:01000004:1.0:1788482863.839189:0:7423:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788482863.839202:0:7423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788482863.839232:0:7423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000c5a67e01) 00000020:00000080:1.0:1788482863.839257:0:7423:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788482863.880267:0:7423:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788482863.880564:0:7423:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788482863.896035:0:7423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788482863.896331:0:7423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788482863.896344:0:7423:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788482863.896359:0:7423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1a155 00000020:01000004:1.0:1788482863.896367:0:7423:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788482863.896395:0:7423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788482863.896399:0:7423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788482863.896406:0:7423:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788482863.896437:0:7423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788482863.896442:0:7423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788482863.921639:0:7423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788482863.921677:0:7423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.154@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788482863.921682:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788482863.921684:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788482863.921685:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482863.921687:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482863.921688:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482863.921689:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482863.921690:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482863.921692:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482863.921693:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482863.921695:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482863.921696:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788482863.921700:0:7423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788482863.921703:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788482863.921704:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788482863.921705:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482863.921706:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482863.921707:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482863.921708:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482863.921709:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482863.921710:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482863.921711:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482863.921712:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482863.921714:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788482863.921740:0:7423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788482863.921758:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079d79f92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098554240:0@lo:253: 00000100:00100000:1.0:1788482863.921826:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482863.921897:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b30e74f going to sleep for 11 seconds 00000100:00100000:0.0:1788482863.922235:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098554240 00000100:00100000:0.0:1788482863.922243:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098554240 00000100:00100000:0.0:1788482863.922301:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788482863.922310:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018063ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098554240:12345-0@lo:253: 20000000:01000000:0.0:1788482863.922340:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788482863.922345:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788482863.922349:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788482863.922352:0:6488:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788482863.922388:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788482863.922817:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482863.922971:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788482863.922990:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788482863.923007:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788482863.923023:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788482863.923037:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788482863.923130:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788482863.923141:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788482863.923157:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788482863.923163:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788482863.923175:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788482863.923181:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788482863.923205:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788482863.923220:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788482863.923316:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788482863.923326:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788482863.923338:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788482863.923343:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788482863.923355:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788482863.923360:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:0.0:1788482863.923371:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788482863.923376:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788482863.923387:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788482863.923400:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788482863.923409:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788482863.924725:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788482863.924750:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788482863.924769:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788482863.924784:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788482863.924798:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788482863.924802:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788482863.924813:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788482863.924832:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788482863.924837:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788482863.924874:0:6488:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788482863.924892:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788482863.925900:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788482863.929426:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788482863.929481:0:6488:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.154@tcp for mdt 20000000:01000000:1.0:1788482863.929483:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788482863.929503:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788482863.929510:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788482863.929521:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788482863.929526:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:1.0:1788482863.929765:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788482863.929778:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788482863.929795:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788482863.929811:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788482863.929891:0:6488:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788482863.929901:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788482863.930457:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788482863.930937:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788482863.930961:0:6488:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.154@tcp for mdt 20000000:01000000:1.0:1788482863.930963:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788482863.930977:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788482863.930983:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788482863.930995:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788482863.931000:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:1.0:1788482863.931010:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788482863.931017:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788482863.931028:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788482863.931042:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788482863.931064:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788482863.931067:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788482863.931070:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788482863.931355:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788482863.931358:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788482863.931823:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788482863.931849:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788482863.931865:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788482863.932046:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788482863.932068:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788482863.932088:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788482863.932294:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788482863.932297:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788482863.932899:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788482863.932926:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788482863.932952:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788482863.933338:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788482863.933375:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788482863.933394:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788482863.933404:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788482863.933411:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788482863.933995:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788482863.934021:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788482863.934036:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788482863.934449:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788482863.934694:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788482863.934716:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788482863.934730:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788482863.934732:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788482863.934737:0:6488:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788482863.934743:0:6488:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788482863.935014:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788482863.935346:0:6488:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788482863.971013:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788482863.971068:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.971089:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.971136:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.971142:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.971149:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.971194:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.971211:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 12 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.971247:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bb31797 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098554368:0@lo:104: 00000100:00100000:1.0:1788482863.971308:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482863.971634:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098554368 00000100:00100000:2.0:1788482863.971642:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098554368 00000100:00100000:2.0:1788482863.971690:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788482863.971699:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaf912a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098554368:12345-0@lo:104: 00010000:00010000:2.0:1788482863.971712:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.971761:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482863.971766:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaf912a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098554368:12345-0@lo:104: Request processed in 69us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.971772:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788482863.971809:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482863.971821:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.971828:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c124dd42 already unused, calling callback (0000000022af2b97) 10000000:00010000:2.0:1788482863.971831:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.971838:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482863.971856:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482863.971863:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482863.971900:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.971907:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482863.971919:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.971925:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 00000000c124dd42/0x1d7ea3d89ea1a116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a11d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.971938:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482863.971940:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482863.971942:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482863.972392:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063de309c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098554496:0@lo:103: 00000100:00100000:2.0:1788482863.972427:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482863.972552:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098554496 00000100:00100000:0.0:1788482863.972558:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098554496 00010000:00010000:0.0:1788482863.972581:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 13 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482863.972624:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482863.972631:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f23072a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3620:x1875360098554496:12345-0@lo:103: 00010000:00010000:0.0:1788482863.972643:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482863.972647:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 13 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482863.972656:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 13 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482863.972673:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482863.972711:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f23072a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3620:x1875360098554496:12345-0@lo:103: Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482863.972718:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788482863.976941:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482863.976950:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063de309c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098554496:0@lo:103: 00010000:00010000:1.0:1788482863.976963:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 12 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.976977:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000493597b6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098554624:0@lo:104: 00000100:00100000:1.0:1788482863.977031:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482863.977150:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.977159:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 12 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.977167:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098554752:0@lo:104: 00000100:00100000:1.0:1788482863.977188:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482863.977610:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000008628eaf8 going to sleep for 11 seconds 00010000:00010000:1.0:1788482863.977636:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f280c7c/0x1d7ea3d89ea1a11d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a116 expref: 12 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.977650:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bb31797 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098554368:0@lo:104: 00000100:00100000:2.0:1788482863.977748:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098554624 00000100:00100000:2.0:1788482863.977756:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098554624 00000100:00100000:2.0:1788482863.979366:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098554752 00000100:00100000:2.0:1788482863.979378:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098554752 00000100:00100000:2.0:1788482863.979411:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482863.979419:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa51d471 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6488:x1875360098554624:12345-0@lo:104: 00010000:00010000:2.0:1788482863.979437:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979565:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482863.979571:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa51d471 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6488:x1875360098554624:12345-0@lo:104: Request processed in 154us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.979577:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482863.979595:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482863.979600:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002eb6c009 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098554752:12345-0@lo:104: 00010000:00010000:2.0:1788482863.979607:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979653:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788482863.979657:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002eb6c009 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098554752:12345-0@lo:104: Request processed in 58us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.979663:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788482863.979681:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788482863.979685:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979693:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ae1270d5 already unused, calling callback (0000000022af2b97) 10000000:00010000:2.0:1788482863.979696:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979703:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482863.979721:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482863.979726:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482863.979757:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979763:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482863.979780:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979787:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 00000000ae1270d5/0x1d7ea3d89ea1a0a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a0ad expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979797:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482863.979799:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979803:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000028b96f85 already unused, calling callback (0000000022af2b97) 10000000:00010000:2.0:1788482863.979806:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979810:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482863.979814:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482863.979819:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482863.979837:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.979844:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482863.979849:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.982249:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482863.983269:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098554880:0@lo:103: 00010000:00010000:2.0:1788482863.983272:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 0000000028b96f85/0x1d7ea3d89ea1a08a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a091 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482863.983318:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a7c41d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098555008:0@lo:103: 00010000:00010000:2.0:1788482863.983343:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482863.983345:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482863.983346:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482863.983347:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482863.983382:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098554880 00000100:00100000:2.0:1788482863.983388:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098554880 00000100:00100000:3.0:1788482863.983414:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482863.983417:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 12 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482863.983439:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555008 00000100:00100000:2.0:1788482863.983442:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555008 00010000:00010000:2.0:1788482863.983452:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 13 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482863.983454:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482863.983462:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bf771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3621:x1875360098554880:12345-0@lo:103: 00000100:00100000:2.0:1788482863.983463:0:6480:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788482863.983469:0:6480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788482863.983482:0:6479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788482863.983491:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482863.983496:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091bb700f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3622:x1875360098555008:12345-0@lo:103: 00010000:00010000:2.0:1788482863.983508:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482863.983513:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 13 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.983535:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 13 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.983553:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482863.983588:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091bb700f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3622:x1875360098555008:12345-0@lo:103: Request processed in 93us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.983595:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788482863.983756:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482863.983760:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 12 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983771:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 12 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983782:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983789:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983800:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983806:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983812:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983818:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983835:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bbebde4c already unused, calling callback (00000000b50db33e) 00010000:00010000:3.0:1788482863.983838:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983845:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983853:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.983863:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482863.983911:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bf771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:3621:x1875360098554880:12345-0@lo:103: Request processed in 450us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482863.983918:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482863.983952:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a7c41d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098555008:0@lo:103: 00000100:00100000:2.0:1788482863.984297:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098554880:0@lo:103: 00010000:00010000:1.0:1788482863.984515:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fa8d2f86/0x1d7ea3d89ea1a0ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a0a6 expref: 11 pid: 6486 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.984527:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000493597b6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098554624:0@lo:104: 00010000:00010000:1.0:1788482863.984537:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a08a expref: 10 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.984553:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098554752:0@lo:104: 00010000:00010000:1.0:1788482863.984572:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.984579:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.984584:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.984589:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a15c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788482863.984602:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788482863.990524:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018063ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:7423:x1875360098554240:12345-0@lo:253: Request processed in 68209us (68691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.990539:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788482863.991082:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079d79f92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098554240:0@lo:253: 10000000:01000000:1.0:1788482863.991113:0:7423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788482863.991116:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788482863.991127:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788482863.991129:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482863.991130:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788482863.991131:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482863.991132:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482863.991134:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482863.991135:0:7423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788482863.991136:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482863.991138:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788482863.991159:0:7423:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e5fcb3b1 from lustre-MDT0001 10000000:01000000:1.0:1788482863.991195:0:7423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788482863.991197:0:7423:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788482863.991203:0:7423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69f45ecd28 local copy 10000000:01000000:1.0:1788482863.991207:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788482863.991253:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.991263:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.991271:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.991287:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079d79f92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555136:0@lo:101: 00000100:00100000:1.0:1788482863.991326:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482863.991353:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555136 00000100:00100000:2.0:1788482863.991360:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555136 00000100:00100000:2.0:1788482863.991403:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788482863.991411:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9807f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:7423:x1875360098555136:12345-0@lo:101: 00010000:00010000:2.0:1788482863.991422:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482863.991435:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b50f41a7/0x1d7ea3d89ea1a16a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a163 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.991457:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b50f41a7/0x1d7ea3d89ea1a16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a163 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.991476:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b50f41a7/0x1d7ea3d89ea1a16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a163 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.991485:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b50f41a7, rc 0) 00000100:00100000:2.0:1788482863.991511:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9807f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:7423:x1875360098555136:12345-0@lo:101: Request processed in 102us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.991524:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788482863.991579:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3ead151 going to sleep for 11 seconds 00000100:00100000:2.0:1788482863.991592:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079d79f92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555136:0@lo:101: 00010000:00010000:2.0:1788482863.991604:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.991612:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482863.991692:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555264:0@lo:501: 00000100:00100000:2.0:1788482863.991717:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482863.991738:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019a8dd5b going to sleep for 11 seconds 00000100:00100000:1.0:1788482863.991895:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555264 00000100:00100000:1.0:1788482863.991899:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555264 00000100:00100000:1.0:1788482863.991936:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482863.991942:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efcd931a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:7423:x1875360098555264:12345-0@lo:501: 00000100:00100000:1.0:1788482863.992004:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efcd931a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:7423:x1875360098555264:12345-0@lo:501: Request processed in 62us (286us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788482863.992011:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788482863.992314:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555264:0@lo:501: 10000000:01000000:2.0:1788482863.992327:0:7423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788482863.992346:0:7423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788482863.992350:0:7423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.992357:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.992363:0:7423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.992384:0:7423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788482863.992408:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69c5051000 10000000:01000000:2.0:1788482863.992413:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788482863.992424:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a69f45ecd28 10000000:01000000:2.0:1788482863.992427:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788482863.992430:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a69f45ecd28 from 1 10000000:01000000:2.0:1788482863.992433:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788482863.992460:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482863.992476:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.992483:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001aa8daeb already unused, calling callback (0000000022af2b97) 10000000:00010000:3.0:1788482863.992486:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.992493:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482863.992500:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482863.992517:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482863.992536:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.992542:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482863.992575:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.992581:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 000000001aa8daeb/0x1d7ea3d89ea1a163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a16a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482863.992596:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482863.992598:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482863.992599:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482863.992605:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482863.992617:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cac5c210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098555392:0@lo:103: 00000100:00100000:3.0:1788482863.992650:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482863.992708:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555392 00000100:00100000:0.0:1788482863.992714:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555392 00010000:00010000:2.0:1788482863.992779:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000e5e25201/0x1d7ea3d89ea1a171 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.992787:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000e5e25201/0x1d7ea3d89ea1a171 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.992795:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000e5e25201/0x1d7ea3d89ea1a171 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482863.992804:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482863.992806:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555520:0@lo:101: 00000100:00100000:0.0:1788482863.992812:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa5ecbce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:3620:x1875360098555392:12345-0@lo:103: 00010000:00010000:0.0:1788482863.992822:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788482863.992830:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482863.992833:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b50f41a7/0x1d7ea3d89ea1a16a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a163 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482863.992859:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482863.992861:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ee9ef86 going to sleep for 11 seconds 00000100:00100000:0.0:1788482863.992906:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa5ecbce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:3620:x1875360098555392:12345-0@lo:103: Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482863.992913:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788482863.992955:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555520 00000100:00100000:1.0:1788482863.992960:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555520 00000100:00100000:1.0:1788482863.992984:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482863.992990:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041ec2991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+9:7423:x1875360098555520:12345-0@lo:101: 00010000:00010000:1.0:1788482863.992998:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482863.993006:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008af9d3f9/0x1d7ea3d89ea1a178 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a171 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993019:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008af9d3f9/0x1d7ea3d89ea1a178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a171 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993028:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008af9d3f9/0x1d7ea3d89ea1a178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a171 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993041:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008af9d3f9, rc 0) 00000100:00100000:2.0:1788482863.993047:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cac5c210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098555392:0@lo:103: 00000100:00100000:1.0:1788482863.993073:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041ec2991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:7423:x1875360098555520:12345-0@lo:101: Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482863.993079:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788482863.993081:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555520:0@lo:101: 00010000:00010000:2.0:1788482863.993090:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000e5e25201/0x1d7ea3d89ea1a171 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a178 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.993115:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000e5e25201/0x1d7ea3d89ea1a171 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a178 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482863.993129:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788482863.993143:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000e5e25201/0x1d7ea3d89ea1a171 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a178 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.993158:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000e5e25201/0x1d7ea3d89ea1a171 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a178 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482863.993173:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a69c5051000 10000000:01000000:2.0:1788482863.993177:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788482863.993180:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a69c5051000 from 1 10000000:01000000:2.0:1788482863.993182:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788482863.993197:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000eb6887b5/0x1d7ea3d89ea1a17f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.993203:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000eb6887b5/0x1d7ea3d89ea1a17f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.993209:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000eb6887b5/0x1d7ea3d89ea1a17f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482863.993219:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555648:0@lo:101: 00000100:00100000:2.0:1788482863.993243:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482863.993258:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ee9ef86 going to sleep for 11 seconds 00000100:00100000:2.0:1788482863.993271:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555648 00000100:00100000:2.0:1788482863.993274:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555648 00000100:00100000:2.0:1788482863.993305:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788482863.993312:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfac7c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+10:7423:x1875360098555648:12345-0@lo:101: 00010000:00010000:2.0:1788482863.993319:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482863.993338:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a5e9e78/0x1d7ea3d89ea1a186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a17f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.993353:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a5e9e78/0x1d7ea3d89ea1a186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a17f expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.993360:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a5e9e78/0x1d7ea3d89ea1a186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a17f expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482863.993371:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a5e9e78, rc 0) 00000100:00100000:2.0:1788482863.993407:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfac7c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:7423:x1875360098555648:12345-0@lo:101: Request processed in 95us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.993413:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482863.993422:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c53e4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555648:0@lo:101: 00010000:00010000:1.0:1788482863.993431:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000eb6887b5/0x1d7ea3d89ea1a17f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993438:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000eb6887b5/0x1d7ea3d89ea1a17f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482863.993448:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788482863.993462:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000eb6887b5/0x1d7ea3d89ea1a17f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993468:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000eb6887b5/0x1d7ea3d89ea1a17f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482863.993474:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788482863.993477:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788482863.993481:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a69c5051000 10000000:01000000:1.0:1788482863.993483:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788482863.993485:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788482863.993487:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788482863.993499:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 000000006a20c8d6/0x1d7ea3d89ea1a18d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993506:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 000000006a20c8d6/0x1d7ea3d89ea1a18d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993518:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 000000006a20c8d6/0x1d7ea3d89ea1a18d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.993529:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555776:0@lo:101: 00000100:00100000:1.0:1788482863.993553:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482863.993573:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555776 00000100:00100000:1.0:1788482863.993578:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555776 00000100:00100000:1.0:1788482863.993600:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788482863.993605:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f71ac91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+11:7423:x1875360098555776:12345-0@lo:101: 00010000:00010000:1.0:1788482863.993612:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482863.993631:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db56164c/0x1d7ea3d89ea1a194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a18d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993645:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db56164c/0x1d7ea3d89ea1a194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993652:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db56164c/0x1d7ea3d89ea1a194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993659:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db56164c, rc 0) 00000100:00100000:1.0:1788482863.993683:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f71ac91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098555776:12345-0@lo:101: Request processed in 78us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482863.993690:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788482863.993717:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc299ef5 going to sleep for 11 seconds 00000100:00100000:1.0:1788482863.993729:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555776:0@lo:101: 00010000:00010000:1.0:1788482863.993738:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 000000006a20c8d6/0x1d7ea3d89ea1a18d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482863.993756:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 000000006a20c8d6/0x1d7ea3d89ea1a18d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482863.993846:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555904:0@lo:501: 00000100:00100000:1.0:1788482863.993869:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482863.993900:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc299ef5 going to sleep for 11 seconds 00000100:00100000:2.0:1788482863.993945:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098555904 00000100:00100000:2.0:1788482863.993950:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098555904 00000100:00100000:2.0:1788482863.993992:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788482863.993998:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8939ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098555904:12345-0@lo:501: 00000100:00100000:2.0:1788482863.994093:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8939ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098555904:12345-0@lo:501: Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482863.994115:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788482863.994228:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098555904:0@lo:501: 00000100:00100000:1.0:1788482863.994255:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556032:0@lo:503: 00000100:00100000:1.0:1788482863.994295:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482863.994315:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc299ef5 going to sleep for 11 seconds 00000100:00100000:0.0:1788482863.994356:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556032 00000100:00100000:0.0:1788482863.994360:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556032 00000100:00100000:0.0:1788482863.994390:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788482863.994395:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060d9a3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098556032:12345-0@lo:503: 00000100:00100000:0.0:1788482863.994478:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060d9a3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098556032:12345-0@lo:503: Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482863.994485:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788482863.994710:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5316ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556032:0@lo:503: 00000040:00080000:2.0:1788482863.995033:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788482863.995265:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000eec84f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556160:0@lo:502: 00000100:00100000:2.0:1788482863.995307:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482863.995376:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ee9ef86 going to sleep for 11 seconds 00000100:00100000:1.0:1788482863.995460:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556160 00000100:00100000:1.0:1788482863.995466:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556160 00000100:00100000:1.0:1788482863.995500:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788482863.995506:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003800d390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098556160:12345-0@lo:502: 00000100:00100000:1.0:1788482863.995723:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003800d390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098556160:12345-0@lo:502: Request processed in 217us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482863.995731:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788482863.995788:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000eec84f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556160:0@lo:502: 00000040:00080000:2.0:1788482863.996503:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788482863.996531:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788482863.996547:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788482863.996562:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788482863.996575:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788482863.996587:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788482863.996599:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788482863.996612:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788482863.996706:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788482863.996729:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788482863.996741:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788482863.996754:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788482863.996769:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788482863.996783:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788482863.996873:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788482863.996901:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788482863.996915:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788482863.996929:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788482863.996943:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788482863.996964:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788482863.996976:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788482863.996989:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788482863.997003:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788482863.997034:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000eec84f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556288:0@lo:502: 00000100:00100000:2.0:1788482863.997269:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482863.997311:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ee9ef86 going to sleep for 11 seconds 00000100:00100000:1.0:1788482863.997369:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556288 00000100:00100000:1.0:1788482863.997376:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556288 00000100:00100000:1.0:1788482863.997459:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788482863.997468:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c896335d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098556288:12345-0@lo:502: 00000100:00100000:1.0:1788482863.997577:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c896335d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098556288:12345-0@lo:502: Request processed in 111us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482863.997585:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788482863.997664:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000eec84f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556288:0@lo:502: 00000040:00080000:2.0:1788482863.997713:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788482863.997723:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788482863.998566:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482863.998577:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482863.998580:0:7437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788482863.998585:0:7437:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788482863.998588:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788482863.998600:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000f3da329e) 00000020:00000080:2.0:1788482863.998696:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788482863.998705:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788482863.998869:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788482863.998878:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1a1a2 00000020:00000080:3.0:1788482863.999559:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788482863.999568:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482863.999572:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482863.999574:0:7437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788482863.999577:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482863.999581:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482863.999583:0:7437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788482863.999587:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788482863.999595:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000006fb6571c) 00000020:00000080:3.0:1788482863.999611:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788482863.999701:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788482863.999704:0:7437:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788482863.999707:0:7437:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788482863.999723:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788482863.999789:0:7437:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e5fcb3b1 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788482863.999874:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000499d971f) 00000020:00000080:3.0:1788482863.999894:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788482863.999967:0:7437:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788482863.999974:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1a1b7 00000020:00000080:3.0:1788482864.000071:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788482864.000078:0:7437:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788482864.000082:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1d7ea3d89ea1a1be 00080000:01000000:3.0:1788482864.000088:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788482864.000092:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1a1c5 00080000:10000000:3.0:1788482864.000905:0:7437:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788482864.001043:0:7437:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788482864.167406:0:7437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788482864.167843:0:7437:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788482864.174437:0:7437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788482864.175427:0:7437:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788482864.218342:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788482864.218363:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482864.218375:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.218377:0:7437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788482864.218381:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482864.218387:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.218389:0:7437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788482864.218392:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788482864.218397:0:7437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:00000080:3.0:1788482864.218430:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788482864.218476:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000009cb506e2) 00000020:00000080:3.0:1788482864.218503:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788482864.218510:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788482864.218585:0:7437:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788482864.218725:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788482864.218735:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1a1d3 00010000:00080000:3.0:1788482864.218770:0:7437:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000559d79a1@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:3.0:1788482864.236059:0:7437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788482864.239996:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788482864.240023:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788482864.240068:0:7437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788482864.240090:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1a1da 00000100:00080000:3.0:1788482864.240114:0:7437:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788482864.240119:0:7437:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000559d79a1 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788482864.240154:0:7437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002dd1fef8 x1875360098556416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788482864.240182:0:7437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788482864.240258:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482864.240271:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000854c80af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098556544:0@lo:400: 00000100:00100000:3.0:1788482864.240341:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482864.240406:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556544 00000100:00100000:3.0:1788482864.240413:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556544 00000100:00100000:3.0:1788482864.240452:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482864.240471:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dff09de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098556544:12345-0@lo:400: 00000100:00100000:3.0:1788482864.240523:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dff09de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098556544:12345-0@lo:400: Request processed in 64us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482864.240530:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788482864.240568:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000854c80af x1875360098556544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482864.240580:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000854c80af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098556544:0@lo:400: 00000020:01000000:3.0:1788482864.241428:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482864.241435:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.241437:0:7437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788482864.241440:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788482864.241442:0:7437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788482864.241444:0:7437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788482864.241445:0:7437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788482864.241453:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788482864.241455:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.241457:0:7437:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788482864.241469:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482864.241474:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.241475:0:7437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788482864.241480:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788482864.241524:0:7437:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788482864.241538:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482864.241542:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.241543:0:7437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788482864.241547:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482864.241549:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.241550:0:7437:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788482864.241553:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788482864.241554:0:7437:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788482864.241583:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482864.241585:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482864.241587:0:7437:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788482864.241588:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1788482864.241723:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002dd1fef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098556416:0@lo:38: 00000100:00100000:2.0:1788482864.241780:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.241865:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556416 00000100:00100000:2.0:1788482864.241872:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556416 00000100:00100000:2.0:1788482864.241919:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482864.241924:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eec84f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098556416:12345-0@lo:38: 00010000:00080000:2.0:1788482864.241948:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1788482864.241995:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1a1e1 00000004:00100000:2.0:1788482864.242008:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788482864.242015:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1788482864.242508:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788482864.242543:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788482864.242565:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 000000006a20c8d6/0x1d7ea3d89ea1a18d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.242575:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 000000006a20c8d6/0x1d7ea3d89ea1a18d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482864.242582:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69c5051000 from 1 10000000:01000000:2.0:1788482864.242585:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788482864.242625:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.242633:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.242653:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482864.242670:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556672:0@lo:101: 00000100:00100000:2.0:1788482864.242710:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.242730:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b64314a3 going to sleep for 11 seconds 00000100:00100000:2.0:1788482864.242750:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556672 00000100:00100000:2.0:1788482864.242754:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556672 00000100:00100000:2.0:1788482864.242786:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788482864.242791:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008906f17e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+12:7423:x1875360098556672:12345-0@lo:101: 00010000:00010000:2.0:1788482864.242800:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482864.242810:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a1e8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.242827:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.242836:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.242843:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000feccbdf7, rc 0) 00000100:00100000:2.0:1788482864.242899:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008906f17e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:7423:x1875360098556672:12345-0@lo:101: Request processed in 108us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482864.242904:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788482864.242946:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556672:0@lo:101: 00010000:00010000:2.0:1788482864.242958:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.242976:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482864.245698:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556800:0@lo:256: 00000100:00100000:2.0:1788482864.245770:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.245810:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b64314a3 going to sleep for 11 seconds 00000100:00100000:1.0:1788482864.247124:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556800 00000100:00100000:1.0:1788482864.247143:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556800 00000100:00100000:1.0:1788482864.247190:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788482864.247199:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002abf8537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:7423:x1875360098556800:12345-0@lo:256: 20000000:01000000:1.0:1788482864.247221:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788482864.247236:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788482864.247239:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788482864.247341:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002abf8537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:7423:x1875360098556800:12345-0@lo:256: Request processed in 144us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482864.247348:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788482864.247970:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556800:0@lo:256: 10000000:01000000:2.0:1788482864.248935:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788482864.248963:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.248974:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482864.248981:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69c5051000 from 1 10000000:01000000:2.0:1788482864.248984:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482864.254680:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.254698:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.254708:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482864.254730:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556928:0@lo:101: 00000100:00100000:2.0:1788482864.254796:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482864.255469:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098556928 00000100:00100000:0.0:1788482864.255479:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098556928 00000100:00100000:0.0:1788482864.255523:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482864.255532:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009212e451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:7423:x1875360098556928:12345-0@lo:101: 00010000:00010000:0.0:1788482864.255544:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482864.255557:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a1f6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.255581:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.255590:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.255597:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0cc5880, rc 0) 00000100:00100000:0.0:1788482864.255634:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009212e451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:7423:x1875360098556928:12345-0@lo:101: Request processed in 104us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.255646:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788482864.256571:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1eda0aa going to sleep for 11 seconds 00000100:00100000:2.0:1788482864.256610:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098556928:0@lo:101: 00010000:00010000:2.0:1788482864.256631:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.256642:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482864.256767:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557056:0@lo:501: 00000100:00100000:2.0:1788482864.256810:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788482864.257139:0:6498:0:(import.c:65:import_set_state_nolock()) 000000000ac91fcd : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482864.257193:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eec84f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098556416:12345-0@lo:38: Request processed in 15267us (15412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.257207:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482864.259349:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1eda0aa going to sleep for 11 seconds 00000100:00100000:2.0:1788482864.259410:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788482864.259419:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788482864.259426:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788482864.259433:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788482864.259436:0:3618:0:(import.c:65:import_set_state_nolock()) 00000000559d79a1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788482864.259457:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002dd1fef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098556416:0@lo:38: 00000100:00100000:0.0:1788482864.259746:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482864.259757:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e798fbb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098557184:0@lo:41: 00000100:00100000:0.0:1788482864.259814:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482864.259860:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557184 00000100:00100000:0.0:1788482864.259865:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557184 00000100:00100000:0.0:1788482864.259907:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482864.259915:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5e80263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098557184:12345-0@lo:41: 00000004:00000024:0.0:1788482864.259941:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788482864.259979:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5e80263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098557184:12345-0@lo:41: Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.259995:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482864.260026:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e798fbb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098557184:0@lo:41: 00010000:00010000:3.0:1788482864.260226:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482864.261620:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557056 00000100:00100000:1.0:1788482864.261632:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557056 00000100:00100000:1.0:1788482864.261678:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788482864.261686:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099a59272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:7423:x1875360098557056:12345-0@lo:501: 00000100:00100000:1.0:1788482864.261828:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099a59272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:7423:x1875360098557056:12345-0@lo:501: Request processed in 144us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482864.261835:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788482864.262199:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557056:0@lo:501: 00000100:00100000:3.0:1788482864.262251:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000854c80af pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557312:0@lo:503: 00000100:00100000:3.0:1788482864.262304:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482864.262379:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a4db127 going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.262549:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557312 00000100:00100000:0.0:1788482864.262554:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557312 00000100:00100000:0.0:1788482864.262621:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788482864.262629:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c03bc35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:7423:x1875360098557312:12345-0@lo:503: 00000040:00080000:0.0:1788482864.262668:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788482864.262714:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c03bc35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:7423:x1875360098557312:12345-0@lo:503: Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.262721:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788482864.262782:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000854c80af pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557312:0@lo:503: 00000040:00080000:3.0:1788482864.263042:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482864.263085:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788482864.263192:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482864.264407:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788482864.264716:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788482864.264745:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788482864.264766:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.264778:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482864.264830:0:7423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788482864.264833:0:7423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69c5051000 10000000:01000000:2.0:1788482864.264835:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69c5051000 10000000:01000000:2.0:1788482864.264848:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788482864.264854:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69c5051000 from 1 10000000:01000000:2.0:1788482864.264856:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788482864.264900:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000c4bf03e1/0x1d7ea3d89ea1a204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.264908:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000c4bf03e1/0x1d7ea3d89ea1a204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.264917:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000c4bf03e1/0x1d7ea3d89ea1a204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482864.264937:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557440:0@lo:101: 00000100:00100000:2.0:1788482864.265002:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.265741:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24d709d going to sleep for 11 seconds 00000100:00100000:1.0:1788482864.265891:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557440 00000100:00100000:1.0:1788482864.265899:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557440 00000100:00100000:1.0:1788482864.265941:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788482864.265949:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a915c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:7423:x1875360098557440:12345-0@lo:101: 00010000:00010000:1.0:1788482864.265962:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482864.265975:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a20b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a204 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482864.266134:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482864.266146:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbebde4c/0x1d7ea3d89ea1a20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482864.266173:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbebde4c, rc 0) 00000100:00100000:1.0:1788482864.266227:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a915c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557440:12345-0@lo:101: Request processed in 278us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482864.266234:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788482864.266353:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557440:0@lo:101: 00010000:00010000:2.0:1788482864.266368:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000c4bf03e1/0x1d7ea3d89ea1a204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482864.266376:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000c4bf03e1/0x1d7ea3d89ea1a204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482864.266485:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557568:0@lo:501: 00000100:00100000:2.0:1788482864.266515:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.266538:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24d709d going to sleep for 11 seconds 00000100:00100000:2.0:1788482864.266553:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557568 00000100:00100000:2.0:1788482864.266557:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557568 00000100:00100000:2.0:1788482864.266578:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788482864.266583:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040d6db41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557568:12345-0@lo:501: 00000100:00100000:2.0:1788482864.266686:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040d6db41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557568:12345-0@lo:501: Request processed in 102us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482864.266693:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788482864.266722:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557568:0@lo:501: 00000100:00100000:2.0:1788482864.266750:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557696:0@lo:503: 00000100:00100000:2.0:1788482864.266784:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.266797:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24d709d going to sleep for 11 seconds 00000100:00100000:2.0:1788482864.266810:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557696 00000100:00100000:2.0:1788482864.266813:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557696 00000100:00100000:2.0:1788482864.266830:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788482864.266834:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031001fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557696:12345-0@lo:503: 00000100:00100000:2.0:1788482864.267196:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031001fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557696:12345-0@lo:503: Request processed in 360us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482864.267204:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788482864.267247:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557696:0@lo:503: 00000040:00080000:2.0:1788482864.267820:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788482864.268263:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557824:0@lo:502: 00000100:00100000:2.0:1788482864.268315:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.268388:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057cb342e going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.268425:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557824 00000100:00100000:0.0:1788482864.268437:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557824 00000100:00100000:0.0:1788482864.269487:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788482864.269501:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d1138b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557824:12345-0@lo:502: 00000100:00100000:0.0:1788482864.269682:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d1138b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557824:12345-0@lo:502: Request processed in 186us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.269690:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788482864.269962:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557824:0@lo:502: 00000040:00080000:3.0:1788482864.270677:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788482864.270711:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788482864.270726:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788482864.270739:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788482864.270750:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788482864.270762:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788482864.270773:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788482864.270784:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788482864.270796:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788482864.270807:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788482864.270821:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788482864.270832:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788482864.270845:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788482864.270952:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788482864.270969:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788482864.270982:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788482864.271076:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788482864.271092:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788482864.271277:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788482864.271293:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788482864.271306:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788482864.271318:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788482864.271330:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788482864.271345:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788482864.271360:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788482864.271374:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788482864.271392:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788482864.271405:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788482864.271444:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000854c80af pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557952:0@lo:502: 00000100:00100000:3.0:1788482864.271588:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482864.271683:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ee9ef86 going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.271735:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098557952 00000100:00100000:0.0:1788482864.271743:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098557952 00000100:00100000:0.0:1788482864.271828:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788482864.271837:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001be3d0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557952:12345-0@lo:502: 00000100:00100000:0.0:1788482864.272234:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001be3d0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098557952:12345-0@lo:502: Request processed in 397us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.272242:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788482864.272409:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000854c80af pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098557952:0@lo:502: 00000040:00080000:3.0:1788482864.272641:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788482864.272655:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788482864.273527:0:7443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788482864.273542:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000065d5a279) 00000020:00000080:0.0:1788482864.273563:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788482864.273647:0:7443:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e5fcb3b1 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788482864.273652:0:7443:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e5fcb3b1 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788482864.273654:0:7443:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e5fcb3b1 3 00010000:00080000:0.0:1788482864.273685:0:7443:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000531c5666@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788482864.277933:0:7443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788482864.278400:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788482864.278597:0:7443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788482864.278621:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1d7ea3d89ea1a219 00000100:00080000:1.0:1788482864.278632:0:7443:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482864.278636:0:7443:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000531c5666 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482864.278684:0:7443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000493597b6 x1875360098558080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788482864.278739:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000493597b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098558080:0@lo:38: 00000100:00100000:3.0:1788482864.278813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788482864.278942:0:7443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788482864.279121:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558080 00000100:00100000:0.0:1788482864.279129:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558080 00000100:00100000:0.0:1788482864.279177:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788482864.279183:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000854c80af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098558080:12345-0@lo:38: 00010000:00080000:0.0:1788482864.279206:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1788482864.279238:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1d7ea3d89ea1a220 00000004:00100000:0.0:1788482864.279252:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788482864.279280:0:6494:0:(import.c:65:import_set_state_nolock()) 0000000001272e20 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788482864.279755:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1788482864.280005:0:7444:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788482864.282652:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000854c80af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875360098558080:12345-0@lo:38: Request processed in 3459us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.282667:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788482864.284208:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000493597b6 x1875360098558080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482864.284224:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482864.284235:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788482864.284244:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788482864.284248:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788482864.284251:0:3618:0:(import.c:65:import_set_state_nolock()) 00000000531c5666 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482864.284257:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000493597b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098558080:0@lo:38: 00000020:01000000:3.0:1788482864.284307:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788482864.284347:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788482864.284490:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000c4bf03e1/0x1d7ea3d89ea1a204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.284501:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000c4bf03e1/0x1d7ea3d89ea1a204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788482864.284553:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788482864.284555:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788482864.284556:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482864.284558:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482864.284559:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482864.284560:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482864.284561:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788482864.284563:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482864.284568:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482864.284570:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482864.284571:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788482864.284574:0:7423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788482864.284576:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788482864.284577:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788482864.284578:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482864.284579:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482864.284580:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482864.284581:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482864.284581:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788482864.284582:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482864.284583:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482864.284584:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482864.284585:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788482864.284607:0:7423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788482864.284621:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009be0f8c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098558208:0@lo:253: 00000100:00100000:3.0:1788482864.284681:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482864.284718:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a4db127 going to sleep for 11 seconds 00000100:00100000:2.0:1788482864.284829:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558208 00000100:00100000:2.0:1788482864.284837:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558208 00000100:00100000:2.0:1788482864.284972:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788482864.284982:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075f59291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098558208:12345-0@lo:253: 20000000:01000000:2.0:1788482864.285151:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788482864.285170:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788482864.287159:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788482864.287198:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788482864.287207:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788482864.287354:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788482864.287360:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788482864.287381:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.287400:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.287407:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.287412:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.287449:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.287462:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 15 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482864.287475:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e798fbb4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098558336:0@lo:104: 00000100:00100000:0.0:1788482864.287536:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482864.287580:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.287601:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 15 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482864.287610:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf9dedc5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098558464:0@lo:104: 00000100:00100000:0.0:1788482864.287637:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482864.287654:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069a5b149 going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.287677:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558336 00000100:00100000:0.0:1788482864.287683:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558336 00000100:00100000:0.0:1788482864.287713:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558464 00000100:00100000:0.0:1788482864.287716:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558464 00000100:00100000:0.0:1788482864.287729:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482864.287736:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d8c70d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6509:x1875360098558336:12345-0@lo:104: 00010000:00010000:0.0:1788482864.287748:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.287796:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482864.287801:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d8c70d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6509:x1875360098558336:12345-0@lo:104: Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.287808:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482864.287825:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482864.287830:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f50ad7d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098558464:12345-0@lo:104: 00010000:00010000:0.0:1788482864.287836:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.288683:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788482864.288691:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f50ad7d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098558464:12345-0@lo:104: Request processed in 861us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.288711:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788482864.288738:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788482864.288743:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.288750:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a5c77e72 already unused, calling callback (0000000022af2b97) 10000000:00010000:0.0:1788482864.288753:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.288761:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482864.288767:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482864.288772:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482864.289258:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482864.291047:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482864.291053:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482864.291055:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482864.291187:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.291201:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf94cd59 already unused, calling callback (0000000022af2b97) 10000000:00010000:3.0:1788482864.291204:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.291212:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482864.291218:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482864.291224:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482864.291278:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.291296:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482864.291324:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.291330:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 00000000bf94cd59/0x1d7ea3d89ea1a140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a147 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.291341:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482864.291342:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482864.291344:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482864.291443:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788482864.291464:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002dd1fef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098558592:0@lo:103: 00000100:00100000:2.0:1788482864.291543:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.292488:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075f59291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7423:x1875360098558208:12345-0@lo:253: Request processed in 7505us (7803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482864.292501:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788482864.292642:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.292652:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482864.292666:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.292672:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a1e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a1ef expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482864.292700:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d942dd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098558720:0@lo:103: 00000100:00100000:0.0:1788482864.292733:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482864.292797:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009be0f8c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7423:1875360098558208:0@lo:253: 10000000:01000000:1.0:1788482864.292811:0:7423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788482864.292814:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788482864.292815:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788482864.292816:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482864.292817:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482864.292818:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482864.292819:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482864.292820:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482864.292821:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482864.292822:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482864.292823:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482864.292836:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788482864.292860:0:7423:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788482864.296187:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e798fbb4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098558336:0@lo:104: 00000100:00100000:0.0:1788482864.296221:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf9dedc5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098558464:0@lo:104: 00010000:00010000:0.0:1788482864.296250:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482864.296269:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482864.296271:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482864.296273:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482864.297139:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558592 00000100:00100000:3.0:1788482864.297149:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558592 00010000:00010000:3.0:1788482864.297186:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 15 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482864.297217:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558720 00000100:00100000:3.0:1788482864.297220:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558720 00010000:00010000:3.0:1788482864.297228:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 16 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482864.297248:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788482864.297255:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a70db62c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3621:x1875360098558592:12345-0@lo:103: 00010000:00010000:3.0:1788482864.297267:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482864.297272:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 16 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297281:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 16 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297296:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000037f8d93a/0x1d7ea3d89ea1a147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a140 expref: 16 pid: 6487 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297320:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482864.297377:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a70db62c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3621:x1875360098558592:12345-0@lo:103: Request processed in 123us (5836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482864.297383:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788482864.297401:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788482864.297406:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000360981da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:3619:x1875360098558720:12345-0@lo:103: 00010000:00010000:3.0:1788482864.297413:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482864.297416:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 14 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297423:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 14 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297431:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000feccbdf7/0x1d7ea3d89ea1a1ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1e8 expref: 14 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297441:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297447:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788482864.297459:0:6480:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010101227s 00010000:00010000:3.0:1788482864.297463:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297469:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297483:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297488:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297493:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001448eab9 already unused, calling callback (00000000b50db33e) 00010000:00010000:3.0:1788482864.297497:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297504:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297518:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297527:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482864.297555:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000360981da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3619:x1875360098558720:12345-0@lo:103: Request processed in 149us (4821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482864.297561:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788482864.297633:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d942dd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098558720:0@lo:103: 00010000:00010000:3.0:1788482864.297660:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297667:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482864.297672:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001448eab9/0x1d7ea3d89ea1a227 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482864.299221:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002dd1fef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098558592:0@lo:103: 00080000:10000000:1.0:1788482864.299382:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788482864.299558:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788482864.299769:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788482864.300260:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788482864.300498:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788482864.300657:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788482864.301692:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788482864.302380:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788482864.302584:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788482864.302745:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788482864.303269:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788482864.303522:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1788482864.305260:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1788482864.305515:0:7450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1788482864.305564:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bb31797 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1875360098558848:0@lo:700: 00000100:00100000:1.0:1788482864.305630:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482864.305665:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b38d699d going to sleep for 11 seconds 00000040:01000000:3.0:1788482864.305714:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:2.0:1788482864.306435:0:7449:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788482864.306441:0:7449:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788482864.306463:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558848 00000100:00100000:2.0:1788482864.306470:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558848 00000100:00100000:2.0:1788482864.306519:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482864.306527:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011964c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1875360098558848:12345-0@lo:700: 00000100:00100000:0.0:1788482864.307161:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf9dedc5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098558976:0@lo:1000: 00000100:00100000:0.0:1788482864.307219:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482864.307246:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003d685a4 going to sleep for 11 seconds 00000100:00100000:1.0:1788482864.307329:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098558976 00000100:00100000:1.0:1788482864.307334:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098558976 00000100:00100000:1.0:1788482864.307374:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788482864.307381:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e798fbb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098558976:12345-0@lo:1000: 00000100:00100000:1.0:1788482864.307455:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e798fbb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098558976:12345-0@lo:1000: Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482864.307463:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482864.307583:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf9dedc5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098558976:0@lo:1000: 00000040:01000000:2.0:1788482864.307612:0:7451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788482864.307637:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559104:0@lo:700: 00000100:00100000:2.0:1788482864.307664:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.307687:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 00000000330d3ea3 going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.307740:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098559104 00000100:00100000:0.0:1788482864.307744:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098559104 00000100:00100000:0.0:1788482864.307775:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482864.307781:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5997ac2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559104:12345-0@lo:700: 00000100:00100000:0.0:1788482864.307829:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5997ac2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559104:12345-0@lo:700: Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.307835:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482864.308071:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559104:0@lo:700: 00000100:00100000:2.0:1788482864.308139:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875360098559232:0@lo:900: 00000100:00100000:2.0:1788482864.308168:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.308192:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 00000000330d3ea3 going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.308283:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098559232 00000100:00100000:0.0:1788482864.308288:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098559232 00000100:00100000:0.0:1788482864.308323:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482864.308330:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000104e9a08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1875360098559232:12345-0@lo:900: 00000100:00100000:0.0:1788482864.308373:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000104e9a08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1875360098559232:12345-0@lo:900: Request processed in 44us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.308379:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788482864.308461:0:7451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000e169ca0 x1875360098559232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788482880 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482864.308473:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875360098559232:0@lo:900: 00000100:00100000:2.0:1788482864.308555:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559360:0@lo:1000: 00000100:00100000:2.0:1788482864.308582:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.308636:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033259b94 going to sleep for 11 seconds 00000100:00100000:1.0:1788482864.308798:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098559360 00000100:00100000:1.0:1788482864.308803:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098559360 00000100:00100000:1.0:1788482864.308944:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788482864.308960:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001372909d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559360:12345-0@lo:1000: 00000100:00100000:1.0:1788482864.309040:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001372909d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559360:12345-0@lo:1000: Request processed in 82us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482864.309046:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482864.309119:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559360:0@lo:1000: 00000004:00080000:2.0:1788482864.309161:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000330d3ea3 with version 0 00000020:00100000:2.0:1788482864.309175:0:7451:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788482864.309180:0:7451:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000e169ca0 x1875360098559616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788482864.309192:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559616:0@lo:1000: 00000100:00100000:2.0:1788482864.309218:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.309462:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4ead4cf going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.309502:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098559616 00000100:00100000:0.0:1788482864.309507:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098559616 00000100:00100000:0.0:1788482864.309530:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482864.309536:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f208d43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559616:12345-0@lo:1000: 00000040:01000000:2.0:1788482864.310492:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788482864.310604:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788482864.314245:0:7423:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788482864.314267:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788482864.314536:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788482864.315652:0:7423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788482864.316962:0:7423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788482864.317036:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788482864.317258:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788482864.317465:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788482864.318090:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788482864.318259:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788482864.318398:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788482864.318539:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788482864.318694:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788482864.318914:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788482864.319068:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788482864.319228:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788482864.319382:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788482864.319517:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788482864.319659:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788482864.320364:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788482864.320561:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788482864.320712:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000001:00080000:1.0:1788482864.322759:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:1.0:1788482864.323191:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788482864.323423:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788482864.323749:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788482864.324152:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788482864.324294:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788482864.324435:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788482864.324573:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788482864.324705:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:0.0:1788482864.325463:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f208d43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559616:12345-0@lo:1000: Request processed in 15921us (16239us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788482864.325477:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:1.0:1788482864.325571:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788482864.325778:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788482864.326170:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788482864.326340:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788482864.326494:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788482864.326651:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788482864.326801:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 40000000:02000000:3.0:1788482864.326960:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00080000:2.0:1788482864.328174:0:7451:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788482864.328182:0:7451:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788482864.328201:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559616:0@lo:1000: 00000100:00100000:2.0:1788482864.328290:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559744:0@lo:1000: 00000100:00100000:2.0:1788482864.328347:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482864.328391:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c27eef6c going to sleep for 11 seconds 00000100:00100000:0.0:1788482864.328449:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098559744 00000100:00100000:0.0:1788482864.328456:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098559744 00000100:00100000:0.0:1788482864.328501:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482864.328509:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a9c4794 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559744:12345-0@lo:1000: 00000100:00100000:0.0:1788482864.328581:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a9c4794 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875360098559744:12345-0@lo:1000: Request processed in 73us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482864.328588:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482864.328615:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875360098559744:0@lo:1000: 00000040:00080000:0.0:1788482864.328630:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788482864.328656:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007456eb78 with version 1 00000004:00080000:1.0:1788482864.330970:0:7440:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000028d5b7b version 1 rpc_version 1 00000020:00100000:1.0:1788482864.331014:0:7440:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788482864.331023:0:7440:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d5ab6db5 x1875360098560000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788482864.331055:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5ab6db5 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7440:1875360098560000:0@lo:1000: 00000100:00100000:1.0:1788482864.331151:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482864.331197:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ef887f0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482864.331216:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560000 00000100:00100000:1.0:1788482864.331223:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560000 00000100:00100000:1.0:1788482864.331254:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788482864.331260:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070926223 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7440:x1875360098560000:12345-0@lo:1000: 00100000:10000000:1.0:1788482864.331603:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788482864.331788:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788482864.331961:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788482864.332175:0:7423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788482864.334924:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788482864.335084:0:7451:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1788482864.336585:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788482864.336704:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070926223 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7440:x1875360098560000:12345-0@lo:1000: Request processed in 5441us (5551us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788482864.336717:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788482864.336762:0:7440:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788482864.336767:0:7440:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788482864.336781:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5ab6db5 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7440:1875360098560000:0@lo:1000: 00000100:00100000:3.0:1788482864.340334:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011964c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1875360098558848:12345-0@lo:700: Request processed in 33802us (34698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482864.340354:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788482864.340418:0:7450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007bb31797 x1875360098558848/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788482880 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482864.340432:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bb31797 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1875360098558848:0@lo:700: 40000000:02000000:3.0:1788482864.340444:0:7450:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1788482864.343904:0:7423:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788482864.343940:0:7423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb53841a57988 00100000:10000000:2.0:1788482864.343947:0:7423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788482864.347315:0:7423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788482864.347341:0:7423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788482864.347362:0:7423:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788482864.347385:0:7423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788482864.350532:0:7423:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788482864.350686:0:7423:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1788482864.395025:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482864.404342:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788482864.406309:0:7450:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788482864.406315:0:7450:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788482865.272342:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482866.297449:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482867.326330:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482868.356936:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788482869.280861:0:7695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788482869.369186:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482869.499566:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002dd1fef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098560128:0@lo:41: 00000100:00100000:2.0:1788482869.499636:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.499991:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560128 00000100:00100000:1.0:1788482869.499999:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560128 00000100:00100000:1.0:1788482869.500054:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788482869.500073:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b450e94e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098560128:12345-0@lo:41: 00000004:00000024:1.0:1788482869.500137:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788482869.500391:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f67690c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098560256:0@lo:400: 00000100:00100000:3.0:1788482869.500426:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482869.500456:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482869.500461:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019d137ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098560384:0@lo:400: 00000100:00100000:3.0:1788482869.500485:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482869.500513:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560384 00000100:00100000:3.0:1788482869.500517:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560384 00000100:00100000:3.0:1788482869.500544:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788482869.500550:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091bb700f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098560384:12345-0@lo:400: 00000100:00100000:3.0:1788482869.500584:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091bb700f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098560384:12345-0@lo:400: Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482869.500601:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788482869.500636:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000019d137ce x1875360098560384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482869.500648:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019d137ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098560384:0@lo:400: 00000100:00100000:1.0:1788482869.500756:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b450e94e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098560128:12345-0@lo:41: Request processed in 684us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.500763:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788482869.500782:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560256 00000100:00100000:1.0:1788482869.500785:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560256 00000100:00100000:1.0:1788482869.500818:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788482869.500834:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d003b385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3621:x1875360098560256:12345-0@lo:400: 00000100:00100000:1.0:1788482869.500877:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d003b385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:3621:x1875360098560256:12345-0@lo:400: Request processed in 45us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.500883:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788482869.500913:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f67690c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098560256:0@lo:400: 00000100:00100000:1.0:1788482869.501189:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004763173f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098560512:0@lo:400: 00000100:00100000:1.0:1788482869.501216:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482869.501277:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560512 00000100:00100000:3.0:1788482869.501281:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560512 00000100:00100000:3.0:1788482869.501311:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788482869.501317:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ab6db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098560512:12345-0@lo:400: 00000100:00100000:3.0:1788482869.501351:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ab6db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098560512:12345-0@lo:400: Request processed in 35us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482869.501357:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788482869.501411:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004763173f x1875360098560512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482869.501420:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004763173f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098560512:0@lo:400: 00000100:00100000:2.0:1788482869.501475:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002dd1fef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098560128:0@lo:41: 00000020:00000004:3.0:1788482870.361504:0:7747:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788482870.361710:0:7747:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788482870.393060:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482871.416595:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788482872.056536:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788482872.056544:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69c5051000 from 4 10000000:01000000:2.0:1788482872.056548:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788482872.056606:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000feccbdf7/0x1d7ea3d89ea1a22e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.056628:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000feccbdf7/0x1d7ea3d89ea1a22e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.056638:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000feccbdf7/0x1d7ea3d89ea1a22e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482872.056674:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098560640:0@lo:101: 00000100:00100000:2.0:1788482872.056742:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.057249:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068940fa7 going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.057378:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560640 00000100:00100000:3.0:1788482872.057387:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560640 00000100:00100000:3.0:1788482872.057520:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788482872.057530:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf38c856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:6491:x1875360098560640:12345-0@lo:101: 00010000:00010000:3.0:1788482872.057544:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482872.057560:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf94cd59/0x1d7ea3d89ea1a235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a22e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.057586:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf94cd59/0x1d7ea3d89ea1a235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.057599:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf94cd59/0x1d7ea3d89ea1a235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.057629:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf94cd59, rc 0) 00000100:00100000:3.0:1788482872.057995:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf38c856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:6491:x1875360098560640:12345-0@lo:101: Request processed in 466us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.058003:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788482872.062881:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098560640:0@lo:101: 00010000:00010000:2.0:1788482872.062913:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000feccbdf7/0x1d7ea3d89ea1a22e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.062925:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000feccbdf7/0x1d7ea3d89ea1a22e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482872.063002:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098560768:0@lo:256: 00000100:00100000:2.0:1788482872.063777:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.063904:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068940fa7 going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.069680:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560768 00000100:00100000:3.0:1788482872.069695:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560768 00000100:00100000:3.0:1788482872.069757:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788482872.069765:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009083739b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:6491:x1875360098560768:12345-0@lo:256: 20000000:01000000:3.0:1788482872.069789:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788482872.069816:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788482872.069819:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788482872.069948:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009083739b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:6491:x1875360098560768:12345-0@lo:256: Request processed in 184us (6172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.069956:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788482872.070168:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098560768:0@lo:256: 10000000:01000000:2.0:1788482872.070215:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788482872.070222:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000feccbdf7/0x1d7ea3d89ea1a22e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.070232:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000feccbdf7/0x1d7ea3d89ea1a22e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482872.070241:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788482872.070243:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69d20cc000 from 21 10000000:01000000:2.0:1788482872.070246:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788482872.070268:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a23c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.070284:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a23c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.070293:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a23c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482872.070307:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098560896:0@lo:101: 00000100:00100000:2.0:1788482872.070335:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.070366:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068940fa7 going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.070427:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098560896 00000100:00100000:1.0:1788482872.070431:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098560896 00000100:00100000:1.0:1788482872.070475:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788482872.070480:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc84e47e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:6491:x1875360098560896:12345-0@lo:101: 00010000:00010000:1.0:1788482872.070488:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482872.070497:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001aa8daeb/0x1d7ea3d89ea1a243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a23c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.070524:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001aa8daeb/0x1d7ea3d89ea1a243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.070532:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001aa8daeb/0x1d7ea3d89ea1a243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.070540:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001aa8daeb, rc 0) 00000100:00100000:1.0:1788482872.070572:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc84e47e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098560896:12345-0@lo:101: Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.070578:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788482872.070690:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098560896:0@lo:101: 00010000:00010000:2.0:1788482872.070701:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a23c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.070709:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a23c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482872.070754:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561024:0@lo:501: 00000100:00100000:2.0:1788482872.070774:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.070799:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068940fa7 going to sleep for 11 seconds 00000100:00100000:0.0:1788482872.071128:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561024 00000100:00100000:0.0:1788482872.071132:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561024 00000100:00100000:0.0:1788482872.071152:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788482872.071157:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ad0beaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098561024:12345-0@lo:501: 00000100:00100000:0.0:1788482872.071284:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ad0beaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098561024:12345-0@lo:501: Request processed in 126us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482872.071309:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788482872.072570:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561024:0@lo:501: 00000100:00100000:2.0:1788482872.072618:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561152:0@lo:503: 00000100:00100000:2.0:1788482872.072666:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.072701:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068940fa7 going to sleep for 11 seconds 00000100:00100000:0.0:1788482872.072907:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561152 00000100:00100000:0.0:1788482872.072913:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561152 00000100:00100000:0.0:1788482872.072950:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788482872.072956:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a0c48ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098561152:12345-0@lo:503: 00000100:00100000:0.0:1788482872.073059:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a0c48ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098561152:12345-0@lo:503: Request processed in 103us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482872.073066:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788482872.074168:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561152:0@lo:503: 00000100:00100000:2.0:1788482872.075544:0:7800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7800:1875360098561280:0@lo:502: 00000100:00100000:2.0:1788482872.075642:0:7800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.075686:0:7800:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1eda0aa going to sleep for 11 seconds 00000100:00100000:0.0:1788482872.075945:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561280 00000100:00100000:0.0:1788482872.075952:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561280 00000100:00100000:0.0:1788482872.076001:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788482872.076009:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea85e572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7800:x1875360098561280:12345-0@lo:502: 00000100:00100000:0.0:1788482872.076170:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea85e572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7800:x1875360098561280:12345-0@lo:502: Request processed in 162us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482872.076177:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788482872.076337:0:7800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7800:1875360098561280:0@lo:502: 00000100:00100000:2.0:1788482872.076384:0:7800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7800:1875360098561408:0@lo:502: 00000100:00100000:2.0:1788482872.076417:0:7800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.076456:0:7800:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1eda0aa going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.077165:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561408 00000100:00100000:3.0:1788482872.077172:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561408 00000100:00100000:3.0:1788482872.077216:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788482872.077224:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000090dce4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7800:x1875360098561408:12345-0@lo:502: 00000100:00100000:3.0:1788482872.077352:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000090dce4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:7800:x1875360098561408:12345-0@lo:502: Request processed in 129us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.077359:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788482872.078146:0:7800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7800:1875360098561408:0@lo:502: 00000040:00080000:2.0:1788482872.078183:0:7800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788482872.078361:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788482872.078388:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788482872.078398:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a23c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.078408:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000a5c77e72/0x1d7ea3d89ea1a23c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482872.078426:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788482872.078428:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69d20cc000 from 4 10000000:01000000:3.0:1788482872.078431:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788482872.078534:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 000000002876cb7e/0x1d7ea3d89ea1a24a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.078542:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 000000002876cb7e/0x1d7ea3d89ea1a24a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.078550:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 000000002876cb7e/0x1d7ea3d89ea1a24a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482872.078707:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561536:0@lo:101: 00000100:00100000:3.0:1788482872.078757:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482872.078878:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6fe184c going to sleep for 11 seconds 00000100:00100000:2.0:1788482872.080209:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561536 00000100:00100000:2.0:1788482872.080220:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561536 00000100:00100000:2.0:1788482872.080282:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788482872.080291:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000624dcc7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098561536:12345-0@lo:101: 00010000:00010000:2.0:1788482872.080306:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482872.080323:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee665437/0x1d7ea3d89ea1a251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a24a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.080348:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee665437/0x1d7ea3d89ea1a251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.080357:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee665437/0x1d7ea3d89ea1a251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.080366:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee665437, rc 0) 00000100:00100000:2.0:1788482872.080438:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000624dcc7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098561536:12345-0@lo:101: Request processed in 148us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482872.080445:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788482872.080733:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561536:0@lo:101: 00010000:00010000:3.0:1788482872.080749:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 000000002876cb7e/0x1d7ea3d89ea1a24a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.080758:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 000000002876cb7e/0x1d7ea3d89ea1a24a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482872.080903:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561664:0@lo:256: 00000100:00100000:3.0:1788482872.080943:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482872.081021:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6fe184c going to sleep for 11 seconds 00000100:00100000:0.0:1788482872.086317:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561664 00000100:00100000:0.0:1788482872.086333:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561664 00000100:00100000:0.0:1788482872.086439:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788482872.086459:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f45012b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098561664:12345-0@lo:256: 20000000:01000000:0.0:1788482872.086485:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788482872.086507:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788482872.086509:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788482872.086658:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f45012b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098561664:12345-0@lo:256: Request processed in 202us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482872.086666:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788482872.086968:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561664:0@lo:256: 10000000:01000000:3.0:1788482872.087022:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788482872.087047:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 000000002876cb7e/0x1d7ea3d89ea1a24a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.087057:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 000000002876cb7e/0x1d7ea3d89ea1a24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482872.087066:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788482872.087068:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788482872.087071:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788482872.087123:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a1ed01ef/0x1d7ea3d89ea1a258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.087130:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 00000000a1ed01ef/0x1d7ea3d89ea1a258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.087138:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 00000000a1ed01ef/0x1d7ea3d89ea1a258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482872.087156:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561792:0@lo:101: 00000100:00100000:3.0:1788482872.087188:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482872.100416:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6fe184c going to sleep for 11 seconds 00000100:00100000:2.0:1788482872.107123:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561792 00000100:00100000:2.0:1788482872.107162:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561792 00000100:00100000:3.0:1788482872.107425:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788482872.107434:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005380df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098561792:12345-0@lo:101: 00010000:00010000:3.0:1788482872.107463:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482872.107480:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045775ae0/0x1d7ea3d89ea1a25f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a258 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.107510:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045775ae0/0x1d7ea3d89ea1a25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.107533:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045775ae0/0x1d7ea3d89ea1a25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.107542:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045775ae0, rc 0) 00000100:00100000:3.0:1788482872.107636:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005380df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098561792:12345-0@lo:101: Request processed in 202us (20448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.107643:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788482872.107874:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bf771b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561792:0@lo:101: 00010000:00010000:2.0:1788482872.107890:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 00000000a1ed01ef/0x1d7ea3d89ea1a258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482872.107899:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 00000000a1ed01ef/0x1d7ea3d89ea1a258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482872.107964:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561920:0@lo:501: 00000100:00100000:2.0:1788482872.107996:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.108027:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057cb342e going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.108418:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098561920 00000100:00100000:3.0:1788482872.108423:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098561920 00000100:00100000:3.0:1788482872.108444:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788482872.108511:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033d1d750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098561920:12345-0@lo:501: 00000100:00100000:3.0:1788482872.109406:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033d1d750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098561920:12345-0@lo:501: Request processed in 894us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.109414:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788482872.109618:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098561920:0@lo:501: 00000100:00100000:2.0:1788482872.109657:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098562048:0@lo:503: 00000100:00100000:2.0:1788482872.109705:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.109733:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057cb342e going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.109867:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562048 00000100:00100000:3.0:1788482872.109872:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562048 00000100:00100000:3.0:1788482872.109898:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788482872.109904:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005604aee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098562048:12345-0@lo:503: 00000100:00100000:3.0:1788482872.110005:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005604aee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098562048:12345-0@lo:503: Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.110012:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788482872.110916:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098562048:0@lo:503: 00000100:00100000:2.0:1788482872.112711:0:7801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7801:1875360098562176:0@lo:502: 00000100:00100000:2.0:1788482872.112780:0:7801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.112818:0:7801:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b64314a3 going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.112872:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562176 00000100:00100000:3.0:1788482872.112880:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562176 00000100:00100000:3.0:1788482872.112923:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788482872.112929:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069f8c8a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:7801:x1875360098562176:12345-0@lo:502: 00000100:00100000:2.0:1788482872.113140:0:7801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd32d570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7801:1875360098562176:0@lo:502: 00000020:01000000:2.0:1788482872.113165:0:7801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482872.113175:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482872.113177:0:7801:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788482872.113181:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788482872.113185:0:7801:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:00000080:2.0:1788482872.119166:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788482872.119189:0:7801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000087399c1a) 00000020:00000080:2.0:1788482872.119229:0:7801:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788482872.119237:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788482872.119357:0:7801:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788482872.119364:0:7801:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788482872.119379:0:7801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a26d 00010000:00080000:2.0:1788482872.119411:0:7801:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fdb4b0ed@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.154@tcp at head 00000100:00100000:3.0:1788482872.119711:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069f8c8a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:7801:x1875360098562176:12345-0@lo:502: Request processed in 6777us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.119729:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:2.0:1788482872.123428:0:7801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788482872.135905:0:7801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788482872.135924:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788482872.135986:0:7801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788482872.136010:0:7801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1a274 00000100:00080000:1.0:1788482872.136021:0:7801:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482872.136026:0:7801:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000fdb4b0ed using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482872.136739:0:7801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000244acec2 x1875360098562304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788482872.136773:0:7801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788482872.136894:0:7801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788482872.138637:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000244acec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098562304:0@lo:38: 00000100:00100000:3.0:1788482872.138726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482872.139822:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562304 00000100:00100000:1.0:1788482872.139834:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562304 00000100:00100000:1.0:1788482872.139887:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788482872.139894:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa5ecbce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098562304:12345-0@lo:38: 00010000:00080000:1.0:1788482872.139927:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1788482872.139962:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1a27b 00000004:00100000:1.0:1788482872.139979:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788482872.140000:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788482872.140750:0:7804:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000bab186dd x1875360098562432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482872.140775:0:7804:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f3092d1 going to sleep for 0 seconds 00000020:01000000:3.0:1788482872.140898:0:7801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482872.140905:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482872.140908:0:7801:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788482872.140911:0:7801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482872.140915:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482872.140916:0:7801:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788482872.140919:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788482872.140921:0:7801:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788482872.140943:0:7801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cac5c210 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7801:1875360098562560:0@lo:502: 00000100:00100000:3.0:1788482872.141016:0:7801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482872.141062:0:7801:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c29e291e going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.145417:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562560 00000100:00100000:1.0:1788482872.145434:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562560 00000100:00100000:1.0:1788482872.145521:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788482872.145530:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfef84f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:7801:x1875360098562560:12345-0@lo:502: 00000100:00100000:1.0:1788482872.145734:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfef84f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:7801:x1875360098562560:12345-0@lo:502: Request processed in 205us (4718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.145741:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788482872.146252:0:7801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cac5c210 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:7801:1875360098562560:0@lo:502: 00000020:01000000:3.0:1788482872.146288:0:7801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482872.146296:0:7801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482872.146300:0:7801:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788482872.146304:0:7801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788482872.146818:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788482872.146856:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788482872.146866:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 00000000a1ed01ef/0x1d7ea3d89ea1a258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.146878:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 00000000a1ed01ef/0x1d7ea3d89ea1a258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482872.146888:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788482872.146890:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a69f45ecd28 from 1 10000000:01000000:1.0:1788482872.146893:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788482872.146924:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 0000000037f8d93a/0x1d7ea3d89ea1a282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.146931:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 0000000037f8d93a/0x1d7ea3d89ea1a282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.146938:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 0000000037f8d93a/0x1d7ea3d89ea1a282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482872.146955:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001bb5a23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098562688:0@lo:101: 00000100:00100000:1.0:1788482872.147015:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482872.147063:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092393ce4 going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.147212:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562688 00000100:00100000:3.0:1788482872.147219:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562688 00000100:00100000:3.0:1788482872.147257:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788482872.147265:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d540f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098562688:12345-0@lo:101: 00010000:00010000:3.0:1788482872.147276:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482872.147290:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a282 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.147313:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.147330:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9dca45f/0x1d7ea3d89ea1a289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482872.147338:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9dca45f, rc 0) 00000100:00100000:3.0:1788482872.147373:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d540f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098562688:12345-0@lo:101: Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.147380:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788482872.147857:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482872.147870:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c386002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098562944:0@lo:400: 00000100:00100000:3.0:1788482872.147912:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482872.147947:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788482872.147954:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788482872.147984:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a66bc675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098563072:0@lo:400: 00000100:00100000:3.0:1788482872.148009:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482872.148128:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482872.148138:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cac5c210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098562816:0@lo:400: 00000100:00100000:0.0:1788482872.148167:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482872.154586:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098563072 00000100:00100000:1.0:1788482872.154602:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098563072 00000100:00100000:1.0:1788482872.154655:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562816 00000100:00100000:1.0:1788482872.154658:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562816 00000100:00100000:1.0:1788482872.154676:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788482872.154684:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000294dfe29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098563072:12345-0@lo:400: 00000100:00100000:1.0:1788482872.154788:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000294dfe29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098563072:12345-0@lo:400: Request processed in 104us (6778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.154796:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788482872.154811:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788482872.154816:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8a2278d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098562816:12345-0@lo:400: 00000100:00100000:1.0:1788482872.154858:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8a2278d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098562816:12345-0@lo:400: Request processed in 43us (6690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.154863:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788482872.154899:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cac5c210 x1875360098562816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482872.154913:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cac5c210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098562816:0@lo:400: 00010000:00080000:0.0:1788482872.155393:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a66bc675 x1875360098563072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482872.155405:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a66bc675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098563072:0@lo:400: 00000100:00100000:1.0:1788482872.156171:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001bb5a23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098562688:0@lo:101: 00010000:00010000:1.0:1788482872.156195:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 0000000037f8d93a/0x1d7ea3d89ea1a282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.156207:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 0000000037f8d93a/0x1d7ea3d89ea1a282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482872.156275:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001bb5a23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098563200:0@lo:501: 00000100:00100000:1.0:1788482872.156325:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482872.156356:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092393ce4 going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.156658:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098563200 00000100:00100000:1.0:1788482872.156664:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098563200 00000100:00100000:1.0:1788482872.156699:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788482872.156706:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000409b07f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098563200:12345-0@lo:501: 00000100:00100000:1.0:1788482872.156776:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000409b07f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098563200:12345-0@lo:501: Request processed in 70us (451us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788482872.156783:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788482872.156806:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001bb5a23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098563200:0@lo:501: 10000000:01000000:1.0:1788482872.156831:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788482872.164299:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: 0000000037f8d93a/0x1d7ea3d89ea1a282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482872.164319:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: 0000000037f8d93a/0x1d7ea3d89ea1a282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788482872.166323:0:6498:0:(import.c:65:import_set_state_nolock()) 00000000670a16f7 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482872.166421:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa5ecbce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098562304:12345-0@lo:38: Request processed in 26525us (27695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.166431:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788482872.166454:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562944 00000100:00100000:1.0:1788482872.166460:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562944 00000100:00100000:1.0:1788482872.166488:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788482872.166549:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788482872.166569:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788482872.166576:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788482872.166581:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788482872.166583:0:3618:0:(import.c:65:import_set_state_nolock()) 00000000fdb4b0ed lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788482872.166604:0:3618:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003f3092d1): req@00000000bab186dd x1875360098562432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482872.166619:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000244acec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098562304:0@lo:38: 00000100:00100000:1.0:1788482872.166751:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ad748ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098562944:12345-0@lo:400: 00000100:00100000:0.0:1788482872.166782:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482872.166813:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ad748ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098562944:12345-0@lo:400: Request processed in 318us (18901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482872.166818:0:7804:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f3092d1 going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.166835:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788482872.166870:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098562432 00000100:00100000:1.0:1788482872.166873:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098562432 00000100:00100000:1.0:1788482872.166887:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788482872.166892:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067a400bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7804:x1875360098562432:12345-0@lo:1000: 00000100:00100000:1.0:1788482872.166978:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067a400bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7804:x1875360098562432:12345-0@lo:1000: Request processed in 86us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.166984:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788482872.167014:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c386002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098562944:0@lo:400: 00000100:00100000:0.0:1788482872.167064:0:7804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098562432:0@lo:1000: 00000040:01000000:0.0:1788482872.167117:0:7804:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788482872.167149:0:7804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563456:0@lo:1000: 00000100:00100000:0.0:1788482872.167178:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482872.167199:0:7804:0:(client.c:2715:ptlrpc_set_wait()) set 00000000415470d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.167254:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098563456 00000100:00100000:1.0:1788482872.167258:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098563456 00000100:00100000:1.0:1788482872.167275:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788482872.167280:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080477632 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7804:x1875360098563456:12345-0@lo:1000: 00000100:00100000:2.0:1788482872.167314:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482872.167326:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f33b2ae1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098563328:0@lo:41: 00000100:00100000:2.0:1788482872.167367:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482872.167400:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080477632 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7804:x1875360098563456:12345-0@lo:1000: Request processed in 118us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.167407:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788482872.167418:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098563328 00000100:00100000:1.0:1788482872.167422:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098563328 00000100:00100000:1.0:1788482872.167439:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482872.167445:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd32d570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098563328:12345-0@lo:41: 00000100:00100000:0.0:1788482872.167460:0:7804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563456:0@lo:1000: 00000004:00000024:1.0:1788482872.167467:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788482872.167504:0:7804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563584:0@lo:700: 00000100:00100000:0.0:1788482872.167533:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482872.167564:0:7804:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f3092d1 going to sleep for 11 seconds 00000100:00100000:2.0:1788482872.167708:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098563584 00000100:00100000:2.0:1788482872.167713:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098563584 00000100:00100000:2.0:1788482872.167747:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788482872.167753:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004763173f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+7:7804:x1875360098563584:12345-0@lo:700: 00000100:00100000:2.0:1788482872.167795:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004763173f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+7:7804:x1875360098563584:12345-0@lo:700: Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482872.167801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482872.167878:0:7804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563584:0@lo:700: 00000100:00100000:0.0:1788482872.168049:0:7804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563712:0@lo:1000: 00000100:00100000:0.0:1788482872.168073:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482872.168083:0:7804:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069fe4cf5 going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.168746:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd32d570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098563328:12345-0@lo:41: Request processed in 1299us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.168754:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482872.168770:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098563712 00000100:00100000:1.0:1788482872.168774:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098563712 00000100:00100000:1.0:1788482872.168804:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482872.168906:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f33b2ae1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098563328:0@lo:41: 00000100:00100000:1.0:1788482872.169038:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f67690c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7804:x1875360098563712:12345-0@lo:1000: 00000100:00100000:1.0:1788482872.169121:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f67690c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7804:x1875360098563712:12345-0@lo:1000: Request processed in 87us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482872.169129:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788482872.169578:0:7804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563712:0@lo:1000: 00000004:00080000:0.0:1788482872.169633:0:7804:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000003f3092d1 with version 0 00000020:00100000:0.0:1788482872.169658:0:7804:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788482872.169664:0:7804:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bab186dd x1875360098563968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788482872.169680:0:7804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563968:0@lo:1000: 00000100:00100000:0.0:1788482872.169712:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482872.169741:0:7804:0:(client.c:2715:ptlrpc_set_wait()) set 000000005dfd0810 going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.169767:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098563968 00000100:00100000:1.0:1788482872.169773:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098563968 00000100:00100000:1.0:1788482872.170260:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788482872.170271:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019d137ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7804:x1875360098563968:12345-0@lo:1000: 00000001:00080000:0.0:1788482872.191949:0:7424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788482872.191964:0:7424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788482872.192613:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019d137ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7804:x1875360098563968:12345-0@lo:1000: Request processed in 22340us (22895us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788482872.192627:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788482872.192732:0:7804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788482872.192737:0:7804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788482872.192752:0:7804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098563968:0@lo:1000: 00000100:00100000:0.0:1788482872.192849:0:7804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098564096:0@lo:1000: 00000100:00100000:0.0:1788482872.192884:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482872.192923:0:7804:0:(client.c:2715:ptlrpc_set_wait()) set 00000000415470d6 going to sleep for 11 seconds 00000100:00100000:3.0:1788482872.192988:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098564096 00000100:00100000:3.0:1788482872.192995:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098564096 00000100:00100000:3.0:1788482872.193050:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482872.193058:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf9dedc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7804:x1875360098564096:12345-0@lo:1000: 00000100:00100000:3.0:1788482872.193322:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf9dedc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7804:x1875360098564096:12345-0@lo:1000: Request processed in 264us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482872.193329:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788482872.197309:0:7804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7804:1875360098564096:0@lo:1000: 00000040:00080000:0.0:1788482872.197345:0:7804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788482872.197390:0:7804:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000003f3092d1 with version 1 00000004:00080000:2.0:1788482872.197729:0:7802:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006659081b version 1 rpc_version 1 00000020:00100000:2.0:1788482872.197765:0:7802:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788482872.197772:0:7802:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000e169ca0 x1875360098564352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788482872.197795:0:7802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7802:1875360098564352:0@lo:1000: 00000100:00100000:2.0:1788482872.197886:0:7802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482872.197947:0:7802:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068940fa7 going to sleep for 11 seconds 00000100:00100000:1.0:1788482872.198660:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098564352 00000100:00100000:1.0:1788482872.198669:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098564352 00000100:00100000:1.0:1788482872.198717:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788482872.198724:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f23072a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7802:x1875360098564352:12345-0@lo:1000: 00000001:00080000:2.0:1788482872.200298:0:7424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788482872.200597:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f23072a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7802:x1875360098564352:12345-0@lo:1000: Request processed in 1870us (2709us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788482872.200611:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788482872.200933:0:7802:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788482872.200940:0:7802:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788482872.200960:0:7802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7802:1875360098564352:0@lo:1000: 00000040:00080000:0.0:1788482872.201761:0:7804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788482872.201857:0:7804:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788482872.201863:0:7804:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788482872.441862:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788482873.250357:0:7855:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788482873.250538:0:7855:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788482873.466051:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788482874.459046:0:7903:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8a4f1c10 20000000:00000080:2.0:1788482874.459063:0:7903:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a69ece61c00 uarg=0000000000000000 20000000:01000000:2.0:1788482874.459414:0:7903:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788482874.459422:0:7903:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788482874.459427:0:7903:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788482874.459503:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788482874.459515:0:7903:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788482874.466819:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788482874.467135:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788482874.467167:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788482874.467181:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788482874.467197:0:7903:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788482874.467214:0:7903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.467232:0:7903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.467239:0:7903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.467255:0:7903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.467291:0:7903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.467304:0:7903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 17 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482874.467318:0:7903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875360098564480:0@lo:104: 00000100:00100000:2.0:1788482874.467385:0:7903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482874.467443:0:7903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.467451:0:7903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 17 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482874.467459:0:7903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a70db62c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875360098564608:0@lo:104: 00000100:00100000:2.0:1788482874.467479:0:7903:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003527703 going to sleep for 11 seconds 00000100:00100000:3.0:1788482874.467938:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788482874.467971:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482874.467997:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098564480 00000100:00100000:3.0:1788482874.468006:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098564480 00000100:00100000:3.0:1788482874.468046:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098564608 00000100:00100000:3.0:1788482874.468050:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098564608 00000100:00100000:3.0:1788482874.468064:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788482874.468070:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c65a579b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:7903:x1875360098564480:12345-0@lo:104: 00010000:00010000:3.0:1788482874.468084:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468179:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788482874.468184:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c65a579b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:7903:x1875360098564480:12345-0@lo:104: Request processed in 115us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482874.468192:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788482874.468231:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788482874.468237:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084cfdef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:7903:x1875360098564608:12345-0@lo:104: 00010000:00010000:3.0:1788482874.468243:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468276:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788482874.468280:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084cfdef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:7903:x1875360098564608:12345-0@lo:104: Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482874.468286:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788482874.468302:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788482874.468307:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468313:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a972dc13 already unused, calling callback (0000000022af2b97) 10000000:00010000:3.0:1788482874.468316:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468323:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482874.468336:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482874.468341:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788482874.468368:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468375:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482874.468395:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468401:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 00000000a972dc13/0x1d7ea3d89ea1a1f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a1fd expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468414:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482874.468416:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468421:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004374e4b9 already unused, calling callback (0000000022af2b97) 10000000:00010000:3.0:1788482874.468423:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468428:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482874.468433:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482874.468438:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788482874.468456:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468461:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482874.468471:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468476:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: 000000004374e4b9/0x1d7ea3d89ea1a108 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a10f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468490:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482874.468492:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482874.468493:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482874.468504:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000636acc74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098564736:0@lo:103: 00000100:00100000:3.0:1788482874.468534:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482874.468570:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098564736 00000100:00100000:3.0:1788482874.468574:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098564736 00010000:00010000:3.0:1788482874.468588:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482874.468607:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788482874.468612:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a66bc675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3620:x1875360098564736:12345-0@lo:103: 00010000:00010000:3.0:1788482874.468620:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482874.468625:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468633:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.468646:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482874.468678:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a66bc675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3620:x1875360098564736:12345-0@lo:103: Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482874.468684:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788482874.468711:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000636acc74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098564736:0@lo:103: 00010000:00010000:1.0:1788482874.468787:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482874.468804:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c386002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098564864:0@lo:103: 00000100:00100000:1.0:1788482874.468841:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482874.468944:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098564864 00000100:00100000:0.0:1788482874.468948:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098564864 00010000:00010000:0.0:1788482874.468963:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482874.468993:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482874.469005:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001bb5a23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3621:x1875360098564864:12345-0@lo:103: 00010000:00010000:0.0:1788482874.469013:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482874.469017:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469025:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469036:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469045:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469058:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469065:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469071:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469076:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469081:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b557fe9 already unused, calling callback (00000000b50db33e) 00010000:00010000:0.0:1788482874.469085:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469092:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469133:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482874.469141:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482874.469173:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001bb5a23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3621:x1875360098564864:12345-0@lo:103: Request processed in 169us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482874.469179:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482874.469204:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c386002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098564864:0@lo:103: 00010000:00010000:2.0:1788482874.469897:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0cc5880/0x1d7ea3d89ea1a1fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a1f6 expref: 17 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482874.469923:0:7903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875360098564480:0@lo:104: 00010000:00010000:2.0:1788482874.469935:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa0eab9e/0x1d7ea3d89ea1a10f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a108 expref: 16 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482874.470012:0:7903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a70db62c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875360098564608:0@lo:104: 00010000:00010000:2.0:1788482874.470030:0:7903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.470047:0:7903:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.470052:0:7903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482874.470057:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b557fe9/0x1d7ea3d89ea1a290 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482874.488817:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482874.618000:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482874.618022:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000636acc74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098564992:0@lo:41: 00000100:00100000:3.0:1788482874.618086:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482874.618175:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098564992 00000100:00100000:3.0:1788482874.618183:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098564992 00000100:00100000:3.0:1788482874.618227:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788482874.618236:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cac5c210 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098564992:12345-0@lo:41: 00000004:00000024:3.0:1788482874.618268:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788482874.618311:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cac5c210 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098564992:12345-0@lo:41: Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482874.618318:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788482874.618359:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000636acc74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098564992:0@lo:41: 00010000:00010000:3.0:1788482875.512353:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482876.536257:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482877.176509:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788482877.176530:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098565120:0@lo:41: 00000100:00100000:0.0:1788482877.176588:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482877.176785:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098565120 00000100:00100000:2.0:1788482877.176794:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098565120 00000100:00100000:2.0:1788482877.176862:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788482877.176872:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d942dd1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098565120:12345-0@lo:41: 00000004:00000024:2.0:1788482877.176910:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788482877.176966:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d942dd1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098565120:12345-0@lo:41: Request processed in 96us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482877.176973:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788482877.177315:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bab186dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098565120:0@lo:41: 00000100:00100000:1.0:1788482877.179844:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482877.179872:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098565632:0@lo:400: 00000100:00100000:2.0:1788482877.179877:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098565504:0@lo:400: 00000100:00100000:3.0:1788482877.180022:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098565376:0@lo:400: 00000100:00100000:1.0:1788482877.182181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482877.182197:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482877.182231:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098565632 00000100:00100000:0.0:1788482877.182240:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098565632 00000100:00100000:1.0:1788482877.182260:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a70db62c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098565248:0@lo:400: 00000100:00100000:0.0:1788482877.182298:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482877.182307:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d44ac31a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098565632:12345-0@lo:400: 00000100:00100000:1.0:1788482877.182328:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482877.182370:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d44ac31a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098565632:12345-0@lo:400: Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482877.182379:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788482877.182382:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002b1c650c x1875360098565632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482877.182397:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b1c650c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098565632:0@lo:400: 00000100:00100000:0.0:1788482877.182410:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098565248 00000100:00100000:0.0:1788482877.182419:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098565248 00000100:00100000:3.0:1788482877.182421:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482877.182461:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788482877.182471:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b572c031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3619:x1875360098565248:12345-0@lo:400: 00000100:00100000:3.0:1788482877.182522:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098565504 00000100:00100000:3.0:1788482877.182532:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098565504 00000100:00100000:0.0:1788482877.182543:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b572c031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3619:x1875360098565248:12345-0@lo:400: Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482877.182551:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788482877.182593:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a70db62c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098565248:0@lo:400: 00000100:00100000:3.0:1788482877.182638:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482877.182652:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0c53e4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098565504:12345-0@lo:400: 00000100:00100000:3.0:1788482877.182752:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0c53e4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098565504:12345-0@lo:400: Request processed in 105us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482877.182760:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482877.182800:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098565376 00000100:00100000:3.0:1788482877.182805:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098565376 00000100:00100000:3.0:1788482877.182852:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788482877.182860:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000636acc74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098565376:12345-0@lo:400: 00000100:00100000:3.0:1788482877.182917:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000636acc74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098565376:12345-0@lo:400: Request processed in 57us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482877.182924:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788482877.182970:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000e169ca0 x1875360098565376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482877.182986:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e169ca0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098565376:0@lo:400: 00000100:00100000:0.0:1788482877.183238:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1176448 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098565504:0@lo:400: 00010000:00010000:3.0:1788482877.561637:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482878.585373:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482879.612919:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482879.739587:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a7c41d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098565760:0@lo:41: 00000100:00100000:3.0:1788482879.739659:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482879.739720:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098565760 00000100:00100000:2.0:1788482879.739729:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098565760 00000100:00100000:2.0:1788482879.739779:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788482879.739788:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bf771b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098565760:12345-0@lo:41: 00000004:00000024:2.0:1788482879.739828:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788482879.739874:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bf771b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098565760:12345-0@lo:41: Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482879.739881:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788482879.739930:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a7c41d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098565760:0@lo:41: 00010000:00010000:0.0:1788482880.637132:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788482881.272419:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788482881.272426:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69c5051000 from 1 10000000:01000000:2.0:1788482881.272431:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482881.272474:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: 0000000096979fad/0x1d7ea3d89ea1a297 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482881.272486:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: 0000000096979fad/0x1d7ea3d89ea1a297 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482881.272496:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: 0000000096979fad/0x1d7ea3d89ea1a297 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482881.272519:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063de309c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098565888:0@lo:101: 00000100:00100000:2.0:1788482881.272591:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482881.272645:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf6fbd15 going to sleep for 11 seconds 00000100:00100000:1.0:1788482881.272835:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098565888 00000100:00100000:1.0:1788482881.272843:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098565888 00000100:00100000:1.0:1788482881.272912:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788482881.272923:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054598174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098565888:12345-0@lo:101: 00010000:00010000:1.0:1788482881.272936:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482881.272949:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac4b6eb4/0x1d7ea3d89ea1a29e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a297 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482881.272971:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac4b6eb4/0x1d7ea3d89ea1a29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482881.272983:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac4b6eb4/0x1d7ea3d89ea1a29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482881.272991:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac4b6eb4, rc 0) 00000100:00100000:1.0:1788482881.273048:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054598174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098565888:12345-0@lo:101: Request processed in 128us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482881.273054:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788482881.273192:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063de309c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098565888:0@lo:101: 00010000:00010000:1.0:1788482881.273206:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: 0000000096979fad/0x1d7ea3d89ea1a297 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482881.273214:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: 0000000096979fad/0x1d7ea3d89ea1a297 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482881.274499:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000651cc23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566016:0@lo:501: 00000100:00100000:1.0:1788482881.274556:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482881.274602:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7693b82 going to sleep for 11 seconds 00000100:00100000:1.0:1788482881.274627:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566016 00000100:00100000:1.0:1788482881.274633:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566016 00000100:00100000:1.0:1788482881.274670:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788482881.274678:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfeeb165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098566016:12345-0@lo:501: 00000100:00100000:1.0:1788482881.274805:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfeeb165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098566016:12345-0@lo:501: Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482881.274812:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788482881.274854:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000651cc23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566016:0@lo:501: 00000100:00100000:1.0:1788482881.274880:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000651cc23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566144:0@lo:503: 00000100:00100000:1.0:1788482881.274914:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482881.274927:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7693b82 going to sleep for 11 seconds 00000100:00100000:1.0:1788482881.274938:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566144 00000100:00100000:1.0:1788482881.274941:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566144 00000100:00100000:1.0:1788482881.274962:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788482881.274967:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8361a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098566144:12345-0@lo:503: 00000100:00100000:1.0:1788482881.275056:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8361a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098566144:12345-0@lo:503: Request processed in 89us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482881.275063:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788482881.275134:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000651cc23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566144:0@lo:503: 00000100:00100000:1.0:1788482881.279281:0:8210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000651cc23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8210:1875360098566272:0@lo:502: 00000100:00100000:1.0:1788482881.279374:0:8210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482881.279416:0:8210:0:(client.c:2715:ptlrpc_set_wait()) set 00000000412b07f5 going to sleep for 11 seconds 00000100:00100000:2.0:1788482881.280174:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566272 00000100:00100000:2.0:1788482881.280184:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566272 00000100:00100000:2.0:1788482881.280239:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788482881.280253:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5d6b70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8210:x1875360098566272:12345-0@lo:502: 00000100:00100000:2.0:1788482881.280385:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5d6b70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8210:x1875360098566272:12345-0@lo:502: Request processed in 139us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482881.280499:0:8210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000651cc23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8210:1875360098566272:0@lo:502: 00000020:01000000:3.0:1788482881.280533:0:8210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482881.280544:0:8210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482881.280546:0:8210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788482881.280554:0:8210:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69c5051000 00000020:00000080:3.0:1788482881.280556:0:8210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788482881.280601:0:8210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8210:1875360098566400:0@lo:502: 00000100:00100000:3.0:1788482881.280642:0:8210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482881.280664:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566400 00000100:00100000:3.0:1788482881.280668:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566400 00000100:00100000:2.0:1788482881.288715:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788482881.288860:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788482881.288877:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8210:x1875360098566400:12345-0@lo:502: 00000100:00100000:3.0:1788482881.289173:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8210:x1875360098566400:12345-0@lo:502: Request processed in 302us (8530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482881.289181:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788482881.289366:0:8210:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482881.289393:0:8210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8210:1875360098566400:0@lo:502: 00000020:01000000:3.0:1788482881.289425:0:8210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482881.289434:0:8210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482881.289438:0:8210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788482881.289515:0:8210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788482881.290481:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788482881.290510:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788482881.290523:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482881.290542:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482881.290580:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788482881.290585:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d20cc000 from 1 10000000:01000000:2.0:1788482881.290589:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482881.290621:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482881.290629:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482881.290638:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482881.290658:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566528:0@lo:101: 00000100:00100000:2.0:1788482881.290706:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482881.290748:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135180 going to sleep for 11 seconds 00000100:00100000:3.0:1788482881.291478:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566528 00000100:00100000:3.0:1788482881.291486:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566528 00000100:00100000:3.0:1788482881.291533:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788482881.291542:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098566528:12345-0@lo:101: 00010000:00010000:3.0:1788482881.291555:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482881.291569:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a2a5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482881.291592:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482881.291603:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482881.291611:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529800, rc 0) 00000100:00100000:3.0:1788482881.291652:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098566528:12345-0@lo:101: Request processed in 110us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482881.291659:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788482881.294027:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566528:0@lo:101: 00010000:00010000:2.0:1788482881.294053:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482881.294066:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482881.294200:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566656:0@lo:501: 00000100:00100000:2.0:1788482881.294259:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482881.294299:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135180 going to sleep for 11 seconds 00000100:00100000:2.0:1788482881.294429:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566656 00000100:00100000:2.0:1788482881.294435:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566656 00000100:00100000:2.0:1788482881.294479:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788482881.294496:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098566656:12345-0@lo:501: 00000100:00100000:2.0:1788482881.294622:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098566656:12345-0@lo:501: Request processed in 127us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482881.294633:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788482881.294670:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566656:0@lo:501: 00000100:00100000:2.0:1788482881.294700:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566784:0@lo:503: 00000100:00100000:2.0:1788482881.294740:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482881.294759:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482881.294817:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566784 00000100:00100000:0.0:1788482881.294822:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566784 00000100:00100000:0.0:1788482881.294858:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788482881.294868:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098566784:12345-0@lo:503: 00000100:00100000:0.0:1788482881.294952:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098566784:12345-0@lo:503: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482881.294958:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788482881.295000:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098566784:0@lo:503: 00000100:00100000:2.0:1788482881.295323:0:8212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8212:1875360098566912:0@lo:502: 00000100:00100000:2.0:1788482881.295356:0:8212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482881.295383:0:8212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135240 going to sleep for 11 seconds 00000100:00100000:0.0:1788482881.295429:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098566912 00000100:00100000:0.0:1788482881.295434:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098566912 00000100:00100000:0.0:1788482881.295456:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788482881.295463:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8212:x1875360098566912:12345-0@lo:502: 00000100:00100000:0.0:1788482881.295542:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8212:x1875360098566912:12345-0@lo:502: Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482881.295549:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788482881.296146:0:8212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8212:1875360098566912:0@lo:502: 00000020:01000000:2.0:1788482881.296174:0:8212:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482881.296183:0:8212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482881.296186:0:8212:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788482881.296193:0:8212:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69d20cc000 00000020:00000080:2.0:1788482881.296196:0:8212:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788482881.296219:0:8212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8212:1875360098567040:0@lo:502: 00000100:00100000:2.0:1788482881.296257:0:8212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482881.296279:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567040 00000100:00100000:2.0:1788482881.296283:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567040 00000100:00100000:2.0:1788482881.296313:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788482881.296320:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8212:x1875360098567040:12345-0@lo:502: 00000100:00100000:2.0:1788482881.296391:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8212:x1875360098567040:12345-0@lo:502: Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482881.296398:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788482881.296440:0:8212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135240 going to sleep for 11 seconds 00000100:00100000:2.0:1788482881.296451:0:8212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8212:1875360098567040:0@lo:502: 00000020:01000000:2.0:1788482881.296468:0:8212:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482881.296472:0:8212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482881.296474:0:8212:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788482881.296477:0:8212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788482881.296630:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788482881.296648:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788482881.296657:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482881.296669:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482881.656341:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482882.296560:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098567168:0@lo:400: 00000100:00100000:3.0:1788482882.296633:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482882.296684:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098567680:0@lo:400: 00000100:00100000:3.0:1788482882.296710:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482882.296733:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482882.296739:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098567296:0@lo:400: 00000100:00100000:3.0:1788482882.296842:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482882.296872:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098567552:0@lo:400: 00000100:00100000:3.0:1788482882.296895:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482882.296991:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482882.296998:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098567424:0@lo:400: 00000100:00100000:3.0:1788482882.297035:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482882.297068:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567680 00000100:00100000:3.0:1788482882.297076:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567680 00000100:00100000:3.0:1788482882.297149:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567424 00000100:00100000:3.0:1788482882.297153:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567424 00000100:00100000:3.0:1788482882.297171:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482882.297179:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098567680:12345-0@lo:400: 00000100:00100000:3.0:1788482882.297233:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098567680:12345-0@lo:400: Request processed in 54us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482882.297239:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482882.297255:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788482882.297262:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098567424:12345-0@lo:400: 00000100:00100000:3.0:1788482882.297294:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098567424:12345-0@lo:400: Request processed in 32us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482882.297459:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567168 00000100:00100000:1.0:1788482882.297464:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567168 00000100:00100000:1.0:1788482882.297496:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788482882.297503:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3621:x1875360098567168:12345-0@lo:400: 00000100:00100000:1.0:1788482882.297535:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3621:x1875360098567168:12345-0@lo:400: Request processed in 32us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482882.297541:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788482882.297599:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788482882.297618:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567296 00000100:00100000:3.0:1788482882.297621:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567296 00000100:00100000:3.0:1788482882.297660:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567552 00000100:00100000:3.0:1788482882.297663:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567552 00000100:00100000:3.0:1788482882.297676:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482882.297681:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098567296:12345-0@lo:400: 00000100:00100000:3.0:1788482882.297712:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098567296:12345-0@lo:400: Request processed in 30us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482882.297717:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482882.297727:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788482882.297733:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098567552:12345-0@lo:400: 00000100:00100000:3.0:1788482882.298001:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098567552:12345-0@lo:400: Request processed in 267us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482882.298008:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788482882.298059:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098567424:0@lo:400: 00010000:00080000:3.0:1788482882.298073:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c59e6a00 x1875360098567552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482882.298083:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098567552:0@lo:400: 00010000:00080000:3.0:1788482882.298189:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c59e6d80 x1875360098567296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482882.298200:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098567296:0@lo:400: 00000100:00100000:3.0:1788482882.298210:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098567168:0@lo:400: 00000100:00100000:3.0:1788482882.298219:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098567680:0@lo:400: 00000100:00100000:0.0:1788482882.302357:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098567808:0@lo:41: 00000100:00100000:0.0:1788482882.302434:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482882.302563:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567808 00000100:00100000:3.0:1788482882.302571:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567808 00000100:00100000:3.0:1788482882.302616:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482882.302626:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098567808:12345-0@lo:41: 00000004:00000024:3.0:1788482882.302664:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788482882.303036:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098567808:12345-0@lo:41: Request processed in 410us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482882.303044:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788482882.304020:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098567808:0@lo:41: 00010000:00010000:3.0:1788482882.686410:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482883.704317:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482884.729276:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788482884.799354:0:8403:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788482884.799358:0:8403:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788482884.799360:0:8403:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788482884.799506:0:8403:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a69e00f6800 00000020:01000004:2.0:1788482884.799521:0:8403:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788482884.799534:0:8403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788482884.799556:0:8403:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a69edaa19b8) 00000020:00000080:2.0:1788482884.799572:0:8403:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788482884.840002:0:8403:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788482884.840063:0:8403:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00000100:00100000:0.0:1788482884.861527:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098567936:0@lo:41: 00000100:00100000:0.0:1788482884.861591:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482884.861665:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098567936 00000100:00100000:0.0:1788482884.861672:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098567936 00000100:00100000:0.0:1788482884.861714:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482884.861722:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098567936:12345-0@lo:41: 00000004:00000024:0.0:1788482884.861752:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788482884.861807:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098567936:12345-0@lo:41: Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482884.861814:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482884.861853:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098567936:0@lo:41: 00080000:01000000:3.0:1788482884.872975:0:8403:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788482884.873950:0:8403:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788482884.873964:0:8403:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788482884.873976:0:8403:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d7ea3d89ea1a2ba 00000020:01000004:3.0:1788482884.873981:0:8403:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788482884.874002:0:8403:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788482884.874005:0:8403:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788482884.874011:0:8403:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788482884.874015:0:8403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788482884.874027:0:8403:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a69f615b370) 00000020:00000080:3.0:1788482884.874038:0:8403:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788482884.875577:0:8403:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482884.875741:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788482884.875746:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788482884.888168:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788482884.888182:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788482884.888566:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788482884.888574:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788482884.891072:0:8403:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482884.891276:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788482884.891282:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788482884.900573:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788482884.900587:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788482884.931424:0:8403:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482884.931670:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788482884.931676:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788482884.933607:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788482884.933620:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788482884.936590:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788482884.936622:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788482884.940378:0:8403:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482884.940660:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788482884.940668:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788482884.942394:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788482884.942406:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788482884.989057:0:8403:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788482884.989325:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788482884.989332:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788482884.991134:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788482884.991146:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788482884.991661:0:8403:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788482884.991691:0:8403:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788482884.991699:0:8403:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788482885.007498:0:8403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788482885.007539:0:8403:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.154@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788482885.007543:0:8403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788482885.007545:0:8403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788482885.007546:0:8403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482885.007547:0:8403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482885.007548:0:8403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482885.007549:0:8403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482885.007551:0:8403:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482885.007552:0:8403:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482885.007554:0:8403:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482885.007555:0:8403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482885.007556:0:8403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482885.007559:0:8403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788482885.007562:0:8403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788482885.007563:0:8403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788482885.007564:0:8403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482885.007565:0:8403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482885.007566:0:8403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482885.007568:0:8403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482885.007569:0:8403:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482885.007570:0:8403:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482885.007571:0:8403:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482885.007572:0:8403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482885.007573:0:8403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482885.007605:0:8403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788482885.007622:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098568064:0@lo:253: 00000100:00100000:3.0:1788482885.007684:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.007811:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482885.007952:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568064 00000100:00100000:0.0:1788482885.007961:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568064 00000100:00100000:0.0:1788482885.008047:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788482885.008057:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8403:x1875360098568064:12345-0@lo:253: 20000000:01000000:0.0:1788482885.008085:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788482885.008089:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788482885.008125:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788482885.008129:0:6488:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788482885.008334:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482885.008471:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788482885.008486:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788482885.008503:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788482885.008510:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788482885.008533:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788482885.008548:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788482885.008636:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788482885.008651:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.154@tcp 20000000:01000000:0.0:1788482885.008653:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788482885.008666:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788482885.008673:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788482885.008686:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788482885.008691:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:0.0:1788482885.008703:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788482885.008710:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788482885.008723:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788482885.008950:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788482885.009019:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788482885.009029:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.154@tcp 20000000:01000000:0.0:1788482885.009031:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788482885.009043:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788482885.009047:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788482885.009059:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788482885.009065:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:0.0:1788482885.009076:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788482885.009082:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788482885.009211:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788482885.009226:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788482885.009614:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788482885.009626:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.154@tcp 20000000:01000000:0.0:1788482885.009628:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788482885.009640:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788482885.009646:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788482885.009658:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788482885.009663:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:0.0:1788482885.009685:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788482885.009691:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788482885.009703:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788482885.009716:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788482885.009729:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788482885.009732:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788482885.009735:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788482885.009924:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788482885.009927:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788482885.010636:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788482885.010666:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788482885.010682:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788482885.010981:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788482885.011003:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788482885.011019:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788482885.011030:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788482885.011032:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788482885.011567:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788482885.011600:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788482885.011613:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788482885.011853:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788482885.011873:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788482885.011887:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788482885.011896:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788482885.011898:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788482885.012254:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788482885.012274:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788482885.012286:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788482885.012424:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788482885.012441:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788482885.012465:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788482885.012475:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788482885.012477:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788482885.012877:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788482885.013026:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788482885.013043:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788482885.013056:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1788482885.013070:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788482885.013091:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013205:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013225:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1a20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013232:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013238:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013245:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1529000/0x1d7ea3d89ea1a289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013251:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013285:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1529000/0x1d7ea3d89ea1a289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013299:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1529000/0x1d7ea3d89ea1a289 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.013313:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc27480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568192:0@lo:104: 00000100:00100000:0.0:1788482885.013372:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482885.013466:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013475:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a25f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.013484:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568320:0@lo:104: 00000100:00100000:0.0:1788482885.013509:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482885.013575:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.013584:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a243 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.013592:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc24380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568448:0@lo:104: 00000100:00100000:0.0:1788482885.013619:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.013679:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568192 00000100:00100000:2.0:1788482885.013687:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568192 00000100:00100000:2.0:1788482885.013724:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568320 00000100:00100000:2.0:1788482885.013727:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568320 00000100:00100000:2.0:1788482885.013825:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788482885.013836:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6488:x1875360098568192:12345-0@lo:104: 00010000:00010000:2.0:1788482885.013848:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.013950:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482885.013957:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6488:x1875360098568192:12345-0@lo:104: Request processed in 123us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.013965:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788482885.013983:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788482885.013989:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098568320:12345-0@lo:104: 00010000:00010000:2.0:1788482885.013996:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014068:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1a20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014076:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1a20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 18 pid: 6488 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.014085:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568576:0@lo:104: 00000100:00100000:0.0:1788482885.014128:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482885.014146:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014154:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a194 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 18 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.014162:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568704:0@lo:104: 00000100:00100000:0.0:1788482885.014181:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.014192:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf1e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788482885.014214:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc27480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568192:0@lo:104: 00000100:00100000:0.0:1788482885.014221:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568320:0@lo:104: 00010000:00010000:3.0:1788482885.014281:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788482885.014289:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014297:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482885.014302:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014311:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482885.014318:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482885.014324:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482885.014360:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014366:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482885.014383:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014396:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a289 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014408:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482885.014411:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014417:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482885.014420:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014426:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482885.014432:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482885.014436:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482885.014449:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014454:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482885.014467:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014473:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a25f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.014482:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482885.014489:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482885.014491:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482885.014504:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098568960:0@lo:103: 00000100:00100000:3.0:1788482885.014534:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.014624:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568960 00000100:00100000:0.0:1788482885.014635:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568960 00010000:00010000:0.0:1788482885.014655:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a25f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 19 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.014685:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482885.014692:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:3621:x1875360098568960:12345-0@lo:103: 00010000:00010000:0.0:1788482885.014702:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482885.014707:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a25f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 19 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014716:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 19 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014728:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a25f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a258 expref: 19 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014739:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482885.014793:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3621:x1875360098568960:12345-0@lo:103: Request processed in 101us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.014799:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482885.014819:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098568832:0@lo:103: 00000100:00100000:0.0:1788482885.014842:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.014880:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568832 00000100:00100000:0.0:1788482885.014884:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568832 00010000:00010000:0.0:1788482885.014897:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1529000/0x1d7ea3d89ea1a289 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.014917:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788482885.014923:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3620:x1875360098568832:12345-0@lo:103: 00010000:00010000:0.0:1788482885.014931:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482885.014941:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1529000/0x1d7ea3d89ea1a289 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014951:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1529000/0x1d7ea3d89ea1a289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014961:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1529000/0x1d7ea3d89ea1a289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a282 expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.014970:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482885.014998:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:3620:x1875360098568832:12345-0@lo:103: Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.015005:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788482885.015031:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098568960:0@lo:103: 00000100:00100000:0.0:1788482885.015053:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098568832:0@lo:103: 00010000:00010000:3.0:1788482885.015336:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482885.015377:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788482885.015386:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098568320:12345-0@lo:104: Request processed in 1396us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.015394:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788482885.015411:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568448 00000100:00100000:2.0:1788482885.015415:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568448 00000100:00100000:2.0:1788482885.015430:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568576 00000100:00100000:2.0:1788482885.015432:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568576 00000100:00100000:2.0:1788482885.015441:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098568704 00000100:00100000:2.0:1788482885.015444:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098568704 00000100:00100000:2.0:1788482885.015455:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788482885.015461:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6488:x1875360098568448:12345-0@lo:104: 00010000:00010000:2.0:1788482885.015470:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.015554:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482885.015560:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6488:x1875360098568448:12345-0@lo:104: Request processed in 98us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.015574:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788482885.015589:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788482885.015594:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6488:x1875360098568576:12345-0@lo:104: 00010000:00010000:2.0:1788482885.015602:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.015632:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788482885.015638:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6488:x1875360098568576:12345-0@lo:104: Request processed in 43us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.015643:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788482885.015654:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788482885.015660:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098568704:12345-0@lo:104: 00010000:00010000:2.0:1788482885.015667:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.015695:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788482885.015700:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6488:x1875360098568704:12345-0@lo:104: Request processed in 41us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.015705:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788482885.015723:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788482885.015727:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.015734:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788482885.015737:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015823:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788482885.015828:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015835:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482885.015838:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015845:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482885.015852:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482885.015858:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482885.015887:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015894:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482885.015907:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015914:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1200/0x1d7ea3d89ea1a204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a20b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015925:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482885.015935:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015942:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482885.015945:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015953:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482885.015960:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482885.015966:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482885.015980:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.015986:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482885.015997:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.016005:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3200/0x1d7ea3d89ea1a18d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a194 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.016015:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482885.016017:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482885.016019:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482885.016035:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482885.016080:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482885.016086:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482885.016091:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482885.016138:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.016145:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482885.016152:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.016159:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a23c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a243 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.016173:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482885.016175:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482885.016177:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482885.016336:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc24380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568448:0@lo:104: 00000100:00100000:0.0:1788482885.016357:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098569088:0@lo:103: 00000100:00100000:0.0:1788482885.016389:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.016476:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098569344:0@lo:103: 00000100:00100000:0.0:1788482885.016500:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.016617:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788482885.016624:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098569216:0@lo:103: 00000100:00100000:0.0:1788482885.016648:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.016672:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569088 00000100:00100000:2.0:1788482885.016677:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569088 00010000:00010000:2.0:1788482885.016697:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1a20b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 17 pid: 6488 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.016732:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569344 00000100:00100000:3.0:1788482885.016736:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569344 00010000:00010000:3.0:1788482885.016761:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a243 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 18 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.016811:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482885.016818:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3622:x1875360098569088:12345-0@lo:103: 00010000:00010000:3.0:1788482885.016828:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482885.016833:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1a20b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 18 pid: 6488 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.016841:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1a20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 18 pid: 6488 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.016856:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482885.016887:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3622:x1875360098569088:12345-0@lo:103: Request processed in 70us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.016894:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482885.016907:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788482885.016913:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:3620:x1875360098569344:12345-0@lo:103: 00010000:00010000:3.0:1788482885.016920:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482885.016924:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a243 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 17 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.016933:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 17 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.016943:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a23c expref: 17 pid: 6487 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.016951:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482885.016973:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3620:x1875360098569344:12345-0@lo:103: Request processed in 60us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.016987:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788482885.017279:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098569344:0@lo:103: 00000100:00100000:0.0:1788482885.017306:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098569088:0@lo:103: 00010000:00010000:0.0:1788482885.017333:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1a20b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a204 expref: 15 pid: 6488 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.017350:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568576:0@lo:104: 00000100:00100000:0.0:1788482885.017363:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875360098568704:0@lo:104: 00010000:00010000:0.0:1788482885.017384:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482885.017485:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569216 00000100:00100000:2.0:1788482885.017490:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569216 00010000:00010000:2.0:1788482885.017506:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a194 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 15 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482885.017523:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788482885.017536:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3620:x1875360098569216:12345-0@lo:103: 00010000:00010000:2.0:1788482885.017544:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482885.017549:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a194 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 15 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017558:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 15 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017568:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a18d expref: 15 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017580:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017587:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017599:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017606:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017611:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017617:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017623:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788482885.017627:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017640:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017652:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.017661:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482885.017694:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:3620:x1875360098569216:12345-0@lo:103: Request processed in 158us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.017701:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788482885.017901:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098569216:0@lo:103: 00010000:00010000:0.0:1788482885.017924:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.017931:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.017938:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a2c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788482885.017954:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788482885.020071:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:8403:x1875360098568064:12345-0@lo:253: Request processed in 12006us (12377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.020085:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788482885.020248:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098568064:0@lo:253: 10000000:01000000:3.0:1788482885.020262:0:8403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788482885.020265:0:8403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788482885.020266:0:8403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788482885.020267:0:8403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482885.020269:0:8403:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788482885.020270:0:8403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482885.020271:0:8403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482885.020273:0:8403:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482885.020274:0:8403:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788482885.020276:0:8403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482885.020277:0:8403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788482885.020296:0:8403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69e00f6800 from lustre-OST0000 10000000:01000000:3.0:1788482885.020323:0:8403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788482885.020326:0:8403:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788482885.020334:0:8403:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69f45ecd28 local copy 10000000:01000000:3.0:1788482885.020338:0:8403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788482885.020371:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.020381:0:8403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.020391:0:8403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.020406:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569472:0@lo:101: 00000100:00100000:3.0:1788482885.020438:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.020461:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985240 going to sleep for 11 seconds 00000100:00100000:1.0:1788482885.020546:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569472 00000100:00100000:1.0:1788482885.020552:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569472 00000100:00100000:1.0:1788482885.020590:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788482885.020598:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+13:8403:x1875360098569472:12345-0@lo:101: 00010000:00010000:1.0:1788482885.020609:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482885.020620:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a2d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a2cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482885.020640:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a2d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2cf expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482885.020650:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a2d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2cf expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482885.020658:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2000, rc 0) 00000100:00100000:1.0:1788482885.020692:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:8403:x1875360098569472:12345-0@lo:101: Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482885.020698:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788482885.020854:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569472:0@lo:101: 00010000:00010000:3.0:1788482885.020878:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.020887:0:8403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.020965:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569600:0@lo:501: 00000100:00100000:3.0:1788482885.020988:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.021008:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985240 going to sleep for 11 seconds 00000100:00100000:0.0:1788482885.021045:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569600 00000100:00100000:0.0:1788482885.021049:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569600 00000100:00100000:0.0:1788482885.021077:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788482885.021083:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:8403:x1875360098569600:12345-0@lo:501: 00000100:00100000:0.0:1788482885.021319:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:8403:x1875360098569600:12345-0@lo:501: Request processed in 235us (328us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788482885.021326:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788482885.021388:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569600:0@lo:501: 10000000:01000000:2.0:1788482885.021400:0:8403:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788482885.021418:0:8403:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788482885.021423:0:8403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.021430:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.021437:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.021460:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788482885.021481:0:8403:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69e00f6800 10000000:01000000:2.0:1788482885.021486:0:8403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788482885.021490:0:8403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788482885.021493:0:8403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788482885.021497:0:8403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788482885.021505:0:8403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788482885.021523:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.021529:0:8403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.021537:0:8403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482885.021549:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569728:0@lo:101: 00000100:00100000:2.0:1788482885.021575:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.021593:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482885.021647:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569728 00000100:00100000:1.0:1788482885.021651:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569728 00000100:00100000:1.0:1788482885.021687:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788482885.021693:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:8403:x1875360098569728:12345-0@lo:101: 00010000:00010000:1.0:1788482885.021699:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482885.021708:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a2dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482885.021722:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482885.021729:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482885.021736:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2600, rc 0) 00000100:00100000:1.0:1788482885.021783:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098569728:12345-0@lo:101: Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482885.021789:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788482885.021911:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569728:0@lo:101: 00010000:00010000:2.0:1788482885.021922:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.021929:0:8403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482885.022010:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569856:0@lo:501: 00000100:00100000:2.0:1788482885.022035:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.022045:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.022059:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569856 00000100:00100000:2.0:1788482885.022062:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569856 00000100:00100000:2.0:1788482885.022081:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788482885.022086:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098569856:12345-0@lo:501: 00000100:00100000:2.0:1788482885.022199:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098569856:12345-0@lo:501: Request processed in 112us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.022214:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788482885.022237:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569856:0@lo:501: 00000100:00100000:2.0:1788482885.022259:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569984:0@lo:503: 00000100:00100000:2.0:1788482885.022294:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.022308:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.022325:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098569984 00000100:00100000:2.0:1788482885.022328:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098569984 00000100:00100000:2.0:1788482885.022344:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788482885.022349:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098569984:12345-0@lo:503: 00000100:00100000:2.0:1788482885.022430:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098569984:12345-0@lo:503: Request processed in 80us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.022436:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788482885.022467:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098569984:0@lo:503: 00000040:00080000:2.0:1788482885.022721:0:8403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788482885.022813:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570112:0@lo:502: 00000100:00100000:2.0:1788482885.022850:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.022859:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.022878:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098570112 00000100:00100000:2.0:1788482885.022882:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098570112 00000100:00100000:2.0:1788482885.022900:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788482885.022905:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570112:12345-0@lo:502: 00000100:00100000:2.0:1788482885.022989:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570112:12345-0@lo:502: Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.022996:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788482885.023035:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570112:0@lo:502: 00000040:00080000:2.0:1788482885.023256:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788482885.023281:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788482885.023295:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788482885.023309:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788482885.023321:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788482885.023332:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788482885.023350:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570240:0@lo:502: 00000100:00100000:2.0:1788482885.023388:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.023410:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.023423:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098570240 00000100:00100000:2.0:1788482885.023427:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098570240 00000100:00100000:2.0:1788482885.023445:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788482885.023450:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570240:12345-0@lo:502: 00000100:00100000:2.0:1788482885.023511:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570240:12345-0@lo:502: Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.023518:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788482885.023552:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570240:0@lo:502: 00000040:00080000:2.0:1788482885.023589:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788482885.023596:0:8403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:0.0:1788482885.023847:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482885.023861:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.023870:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482885.023875:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.023883:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482885.023891:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482885.023896:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482885.023918:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.023924:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482885.023948:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.023955:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1528600/0x1d7ea3d89ea1a2cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a2d6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.023968:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482885.023970:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482885.023971:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482885.023977:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482885.023987:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098570368:0@lo:103: 00000100:00100000:0.0:1788482885.024016:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.024044:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098570368 00000100:00100000:0.0:1788482885.024054:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098570368 00000100:00100000:0.0:1788482885.024086:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482885.024093:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3622:x1875360098570368:12345-0@lo:103: 00010000:00010000:0.0:1788482885.024124:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482885.024137:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a2d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2cf expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.024148:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482885.024173:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:3622:x1875360098570368:12345-0@lo:103: Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.024180:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482885.024209:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098570368:0@lo:103: 00000020:01000000:0.0:1788482885.025015:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788482885.025023:0:8426:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788482885.025030:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482885.025032:0:8426:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788482885.025038:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788482885.025051:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a69d2878000) 00000020:00000080:0.0:1788482885.025075:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788482885.025081:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788482885.025230:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69e00f6800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788482885.025239:0:8426:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788482885.025246:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d7ea3d89ea1a2f2 00010000:00010000:0.0:1788482885.030224:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788482885.030529:0:8426:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788482885.033315:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788482885.033671:0:8426:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788482885.041389:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788482885.041579:0:8426:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788482885.047065:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788482885.048464:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788482885.048476:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482885.048481:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482885.048484:0:8426:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788482885.048486:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482885.048490:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482885.048491:0:8426:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788482885.048494:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788482885.048495:0:8426:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788482885.048518:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482885.048520:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482885.048521:0:8426:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788482885.048524:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788482885.048673:0:8403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788482885.048701:0:8403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788482885.048724:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.048736:0:8403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482885.048754:0:8403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69e00f6800 from 1 10000000:01000000:2.0:1788482885.048763:0:8403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482885.048809:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.048817:0:8403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.048828:0:8403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482885.048849:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570496:0@lo:101: 00000100:00100000:2.0:1788482885.048912:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.048948:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.048971:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098570496 00000100:00100000:2.0:1788482885.048978:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098570496 00000100:00100000:2.0:1788482885.049012:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788482885.049021:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:8403:x1875360098570496:12345-0@lo:101: 00010000:00010000:2.0:1788482885.049034:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482885.049045:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a2f9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.049067:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.049077:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.049085:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1200, rc 0) 00000100:00100000:2.0:1788482885.049145:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570496:12345-0@lo:101: Request processed in 124us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.049159:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788482885.049202:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570496:0@lo:101: 00010000:00010000:2.0:1788482885.049216:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.049226:0:8403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482885.049302:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570624:0@lo:501: 00000100:00100000:2.0:1788482885.049327:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.049340:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482885.050899:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098570624 00000100:00100000:0.0:1788482885.050909:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098570624 00000100:00100000:0.0:1788482885.050951:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788482885.050959:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570624:12345-0@lo:501: 00000100:00100000:0.0:1788482885.051115:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570624:12345-0@lo:501: Request processed in 156us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.051122:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788482885.051251:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570624:0@lo:501: 00000100:00100000:2.0:1788482885.051295:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570752:0@lo:503: 00000100:00100000:2.0:1788482885.051343:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.051369:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.051387:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098570752 00000100:00100000:2.0:1788482885.051391:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098570752 00000100:00100000:2.0:1788482885.051413:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788482885.051418:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570752:12345-0@lo:503: 00000100:00100000:2.0:1788482885.051502:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570752:12345-0@lo:503: Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.051508:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788482885.051551:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570752:0@lo:503: 00000040:00080000:2.0:1788482885.052162:0:8403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788482885.052230:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570880:0@lo:502: 00000100:00100000:2.0:1788482885.052280:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.052297:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.052313:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098570880 00000100:00100000:2.0:1788482885.052318:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098570880 00000100:00100000:2.0:1788482885.054898:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788482885.054916:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570880:12345-0@lo:502: 00000100:00100000:2.0:1788482885.055092:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098570880:12345-0@lo:502: Request processed in 181us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.055115:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788482885.055234:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098570880:0@lo:502: 00000040:00080000:3.0:1788482885.055510:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788482885.055546:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788482885.055578:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571008:0@lo:502: 00000100:00100000:3.0:1788482885.055623:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.055889:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482885.055948:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571008 00000100:00100000:1.0:1788482885.055957:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571008 00000100:00100000:1.0:1788482885.055989:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788482885.055997:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098571008:12345-0@lo:502: 00000100:00100000:1.0:1788482885.056162:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098571008:12345-0@lo:502: Request processed in 166us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482885.056170:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788482885.056841:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571008:0@lo:502: 00000040:00080000:3.0:1788482885.056903:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788482885.056913:0:8403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788482885.057452:0:8430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482885.057461:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482885.057464:0:8430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788482885.057470:0:8430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69e00f6800 00000020:00000080:1.0:1788482885.057473:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788482885.057485:0:8430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482885.057493:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482885.057494:0:8430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788482885.057497:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788482885.057639:0:8403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788482885.057659:0:8403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788482885.057717:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.057728:0:8403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482885.057790:0:8403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788482885.057793:0:8403:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69e00f6800 10000000:01000000:3.0:1788482885.057802:0:8403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69e00f6800 10000000:01000000:3.0:1788482885.057806:0:8403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788482885.057812:0:8403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69e00f6800 from 1 10000000:01000000:3.0:1788482885.057815:0:8403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788482885.057842:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.057850:0:8403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.057859:0:8403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.057877:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571136:0@lo:101: 00000100:00100000:3.0:1788482885.057922:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.057959:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.059765:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571136 00000100:00100000:2.0:1788482885.059784:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571136 00000100:00100000:2.0:1788482885.059834:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788482885.059843:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8403:x1875360098571136:12345-0@lo:101: 00010000:00010000:2.0:1788482885.059856:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482885.059871:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a307 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.059896:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.059906:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.059915:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1800, rc 0) 00000100:00100000:2.0:1788482885.059968:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571136:12345-0@lo:101: Request processed in 126us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.059974:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788482885.060144:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571136:0@lo:101: 00010000:00010000:3.0:1788482885.060162:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.060171:0:8403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.060267:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571264:0@lo:501: 00000100:00100000:3.0:1788482885.060296:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.060328:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482885.060408:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571264 00000100:00100000:0.0:1788482885.060413:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571264 00000100:00100000:0.0:1788482885.060437:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788482885.060444:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571264:12345-0@lo:501: 00000100:00100000:0.0:1788482885.060537:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571264:12345-0@lo:501: Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.060544:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788482885.060705:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571264:0@lo:501: 00000100:00100000:3.0:1788482885.060728:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571392:0@lo:503: 00000100:00100000:3.0:1788482885.060852:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.060873:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.060937:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571392 00000100:00100000:2.0:1788482885.060948:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571392 00000100:00100000:2.0:1788482885.060982:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788482885.060989:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571392:12345-0@lo:503: 00000100:00100000:2.0:1788482885.061069:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571392:12345-0@lo:503: Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.061075:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788482885.061189:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571392:0@lo:503: 00000040:00080000:3.0:1788482885.061431:0:8403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788482885.061489:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571520:0@lo:502: 00000100:00100000:3.0:1788482885.061525:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.061554:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482885.061626:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571520 00000100:00100000:0.0:1788482885.061630:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571520 00000100:00100000:0.0:1788482885.061650:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788482885.061664:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571520:12345-0@lo:502: 00000100:00100000:0.0:1788482885.061834:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571520:12345-0@lo:502: Request processed in 171us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.061840:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788482885.061961:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571520:0@lo:502: 00000040:00080000:3.0:1788482885.062164:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788482885.062189:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788482885.062202:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788482885.062214:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788482885.062227:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788482885.062240:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788482885.062266:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788482885.062281:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788482885.062293:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788482885.062306:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788482885.062318:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788482885.062331:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788482885.062344:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788482885.062358:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788482885.062369:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788482885.062381:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788482885.062393:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788482885.062406:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788482885.062418:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788482885.062430:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788482885.062442:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788482885.062455:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788482885.062489:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788482885.062504:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788482885.062517:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788482885.062529:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788482885.062542:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788482885.062555:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788482885.062568:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788482885.062580:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788482885.062592:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788482885.062603:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788482885.062613:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788482885.062624:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788482885.062633:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788482885.062643:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788482885.062653:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1788482885.062677:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571648:0@lo:502: 00000100:00100000:3.0:1788482885.062716:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.062736:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482885.062875:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571648 00000100:00100000:0.0:1788482885.062880:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571648 00000100:00100000:0.0:1788482885.062910:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788482885.062917:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571648:12345-0@lo:502: 00000100:00100000:0.0:1788482885.063007:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098571648:12345-0@lo:502: Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.063014:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788482885.063409:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098571648:0@lo:502: 00000040:00080000:2.0:1788482885.063461:0:8403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788482885.063472:0:8403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788482885.063952:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788482885.063965:0:8431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a69d287cd28) 00000020:00000080:0.0:1788482885.063985:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788482885.064065:0:8431:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69e00f6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788482885.064069:0:8431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69e00f6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788482885.064071:0:8431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69e00f6800 3 00010000:00080000:0.0:1788482885.064282:0:8431:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69ed823800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788482885.067030:0:8431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788482885.067390:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788482885.067436:0:8431:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788482885.067449:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1d7ea3d89ea1a31c 00000100:00080000:2.0:1788482885.067459:0:8431:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788482885.067464:0:8431:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a69ed823800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788482885.067498:0:8431:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f38000 x1875360098571776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788482885.067580:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098571776:0@lo:38: 00000100:00100000:3.0:1788482885.067648:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482885.067730:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571776 00000100:00100000:1.0:1788482885.067737:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571776 00000100:00100000:1.0:1788482885.067793:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788482885.067800:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098571776:12345-0@lo:38: 00010000:00080000:1.0:1788482885.067822:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:1.0:1788482885.067865:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1d7ea3d89ea1a323 00000004:00100000:1.0:1788482885.067878:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788482885.067909:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9a69f7363800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788482885.067967:0:8431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788482885.069727:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098571904:0@lo:400: 00000100:00100000:0.0:1788482885.071939:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.072032:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098572032:0@lo:400: 00000100:00100000:0.0:1788482885.072063:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.072077:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482885.072084:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098572160:0@lo:400: 00000100:00100000:0.0:1788482885.072133:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.072880:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788482885.072890:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788482885.072969:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572160 00000100:00100000:3.0:1788482885.072977:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572160 00000100:00100000:3.0:1788482885.073033:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788482885.073041:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098572160:12345-0@lo:400: 00000100:00100000:3.0:1788482885.073126:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098572160:12345-0@lo:400: Request processed in 83us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.073133:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788482885.073155:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788482885.073162:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098571904 00000100:00100000:3.0:1788482885.073165:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098571904 00000100:00100000:3.0:1788482885.073192:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788482885.073208:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572032 00000100:00100000:3.0:1788482885.073213:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572032 00000100:00100000:3.0:1788482885.073227:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788482885.073232:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788482885.073237:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098571904:12345-0@lo:400: 00000100:00100000:3.0:1788482885.073274:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098571904:12345-0@lo:400: Request processed in 37us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.073280:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788482885.073290:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788482885.073295:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788482885.073301:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098572032:12345-0@lo:400: 00000100:00100000:3.0:1788482885.073325:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098572032:12345-0@lo:400: Request processed in 25us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.073330:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788482885.073366:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098572160:0@lo:400: 00010000:00080000:3.0:1788482885.073382:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c1ca4a80 x1875360098572032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482885.073393:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098572032:0@lo:400: 00010000:00080000:3.0:1788482885.073422:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c1ca4700 x1875360098571904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482885.073431:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098571904:0@lo:400: 00000020:01000004:0.0:1788482885.075227:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788482885.075257:0:8431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a68c24e19b8) 00000020:00000080:0.0:1788482885.075286:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788482885.075376:0:8431:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69e00f6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788482885.075380:0:8431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69e00f6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788482885.075382:0:8431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69e00f6800 3 00010000:00080000:0.0:1788482885.075410:0:8431:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c24e9000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.154@tcp at head 00000100:00100000:1.0:1788482885.075915:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875360098571776:12345-0@lo:38: Request processed in 8110us (8262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482885.075926:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788482885.077219:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69d0f38000 x1875360098571776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482885.077234:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482885.077244:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788482885.077259:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788482885.077263:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788482885.077266:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482885.077273:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098571776:0@lo:38: 00010000:00010000:0.0:1788482885.077957:0:8431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788482885.080387:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788482885.080435:0:8431:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788482885.080448:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1d7ea3d89ea1a331 00000100:00080000:0.0:1788482885.080458:0:8431:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788482885.080464:0:8431:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a68c24e9000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788482885.080516:0:8431:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c1ca6a00 x1875360098572288/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788482885.080580:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098572288:0@lo:38: 00000100:00100000:3.0:1788482885.080651:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788482885.080712:0:8431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788482885.084030:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572288 00000100:00100000:0.0:1788482885.084043:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572288 00000100:00100000:0.0:1788482885.084086:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482885.084111:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098572288:12345-0@lo:38: 00010000:00080000:0.0:1788482885.084140:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1788482885.084936:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1d7ea3d89ea1a338 00000004:00100000:0.0:1788482885.084954:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788482885.084988:0:6494:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482885.086140:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875360098572288:12345-0@lo:38: Request processed in 2041us (5484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.086152:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1788482885.086253:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788482885.086422:0:8403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788482885.086451:0:8403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788482885.086471:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.086482:0:8403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788482885.086533:0:8403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788482885.086535:0:8403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788482885.086536:0:8403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482885.086537:0:8403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482885.086538:0:8403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482885.086539:0:8403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482885.086541:0:8403:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788482885.086542:0:8403:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482885.086544:0:8403:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482885.086545:0:8403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482885.086546:0:8403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788482885.086550:0:8403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788482885.086552:0:8403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788482885.086553:0:8403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788482885.086554:0:8403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482885.086555:0:8403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482885.086556:0:8403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482885.086557:0:8403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482885.086558:0:8403:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788482885.086559:0:8403:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482885.086560:0:8403:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482885.086561:0:8403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482885.086562:0:8403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788482885.086581:0:8403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788482885.086594:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098572416:0@lo:253: 00000100:00100000:2.0:1788482885.086640:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.086668:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93ed80 going to sleep for 11 seconds 00010000:00080000:3.0:1788482885.086942:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c1ca6a00 x1875360098572288/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482885.086953:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482885.086960:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788482885.086966:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788482885.086970:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788482885.086973:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c24e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482885.086979:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098572288:0@lo:38: 00000100:00100000:3.0:1788482885.087008:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572416 00000100:00100000:3.0:1788482885.087013:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572416 00000100:00100000:3.0:1788482885.087079:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788482885.087087:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098572416:12345-0@lo:253: 20000000:01000000:3.0:1788482885.087136:0:6487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788482885.087148:0:6487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788482885.094952:0:6487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788482885.094969:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788482885.095137:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788482885.095143:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788482885.095169:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.095187:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1529400/0x1d7ea3d89ea1a235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.095195:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.095202:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.095236:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.095250:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a251 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 16 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.095264:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098572544:0@lo:104: 00000100:00100000:0.0:1788482885.095321:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482885.095361:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1529400/0x1d7ea3d89ea1a235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.095369:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1529400/0x1d7ea3d89ea1a235 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 16 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.095377:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098572672:0@lo:104: 00000100:00100000:0.0:1788482885.095392:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1c59900 going to sleep for 11 seconds 00000100:00100000:2.0:1788482885.095656:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788482885.095674:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482885.095691:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572544 00000100:00100000:2.0:1788482885.095697:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572544 00000100:00100000:2.0:1788482885.095733:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572672 00000100:00100000:2.0:1788482885.095736:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572672 00000100:00100000:3.0:1788482885.095871:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:8403:x1875360098572416:12345-0@lo:253: Request processed in 8783us (9228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.095880:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788482885.095938:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482885.095947:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6509:x1875360098572544:12345-0@lo:104: 00010000:00010000:2.0:1788482885.095963:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096015:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482885.096021:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6509:x1875360098572544:12345-0@lo:104: Request processed in 76us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.096027:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482885.096056:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788482885.096062:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098572672:12345-0@lo:104: 00010000:00010000:2.0:1788482885.096069:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096119:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788482885.096125:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098572672:12345-0@lo:104: Request processed in 63us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482885.096131:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788482885.096172:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788482885.096177:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096185:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788482885.096189:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096198:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482885.096205:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482885.096217:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482885.096241:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096247:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482885.096259:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096266:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1529c00/0x1d7ea3d89ea1a24a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a251 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096275:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482885.096278:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096283:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788482885.096287:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096293:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482885.096300:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482885.096304:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482885.096313:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096317:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482885.096326:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096333:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0800/0x1d7ea3d89ea1a22e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a235 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482885.096344:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482885.096345:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482885.096347:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482885.096414:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482885.096430:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098572928:0@lo:103: 00000100:00100000:3.0:1788482885.096456:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.096476:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482885.096481:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098572800:0@lo:103: 00000100:00100000:3.0:1788482885.096496:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482885.096548:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572928 00000100:00100000:3.0:1788482885.096552:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572928 00010000:00010000:3.0:1788482885.096567:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1529400/0x1d7ea3d89ea1a235 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 16 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.096585:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098572800 00000100:00100000:3.0:1788482885.096587:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098572800 00010000:00010000:3.0:1788482885.096595:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a251 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 17 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482885.096610:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788482885.096615:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:3622:x1875360098572928:12345-0@lo:103: 00010000:00010000:3.0:1788482885.096624:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482885.096629:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1529400/0x1d7ea3d89ea1a235 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 17 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096638:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1529400/0x1d7ea3d89ea1a235 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 17 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096651:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482885.096673:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:3622:x1875360098572928:12345-0@lo:103: Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.096678:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788482885.096689:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788482885.096693:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3622:x1875360098572800:12345-0@lo:103: 00010000:00010000:3.0:1788482885.096705:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482885.096709:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a251 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 16 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096718:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a251 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 16 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096729:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096736:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788482885.096760:0:7436:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010101227s 00010000:00010000:3.0:1788482885.096764:0:7436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096779:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096786:0:7436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096792:0:7436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096797:0:7436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788482885.096801:0:7436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096807:0:7436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096823:0:7436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482885.096831:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482885.096857:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3622:x1875360098572800:12345-0@lo:103: Request processed in 162us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482885.096862:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788482885.096897:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098572800:0@lo:103: 00000100:00100000:3.0:1788482885.096905:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098572928:0@lo:103: 00010000:00010000:0.0:1788482885.097067:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a251 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a24a expref: 15 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.097088:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098572544:0@lo:104: 00010000:00010000:0.0:1788482885.097130:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1529400/0x1d7ea3d89ea1a235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a22e expref: 14 pid: 6486 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482885.097139:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098572672:0@lo:104: 00010000:00010000:0.0:1788482885.097151:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.097159:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.097165:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482885.097170:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0031400/0x1d7ea3d89ea1a33f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482885.097342:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8403:1875360098572416:0@lo:253: 10000000:01000000:1.0:1788482885.097353:0:8403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788482885.097356:0:8403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788482885.097357:0:8403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788482885.097359:0:8403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482885.097360:0:8403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482885.097361:0:8403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482885.097363:0:8403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482885.097364:0:8403:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788482885.097366:0:8403:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482885.097367:0:8403:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482885.097368:0:8403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482885.097370:0:8403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788482885.097379:0:8403:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788482885.101933:0:8403:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788482885.102305:0:8403:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788482885.102533:0:8403:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788482885.102681:0:8403:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788482885.102964:0:8403:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788482885.103247:0:8403:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788482885.104245:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788482885.114074:0:8403:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788482885.114083:0:8403:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788482885.114301:0:8403:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788482885.114341:0:8403:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788482885.114364:0:8403:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788482885.114402:0:8403:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788482885.115239:0:8403:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788482885.115399:0:8403:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788482885.753499:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788482886.223477:0:8489:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788482886.223727:0:8489:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788482886.779323:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788482887.098495:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788482887.098502:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69c5051000 from 30 10000000:01000000:0.0:1788482887.098507:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788482887.098552:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.098564:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.098575:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482887.098597:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573056:0@lo:101: 00000100:00100000:0.0:1788482887.098658:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482887.098704:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.098796:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573056 00000100:00100000:3.0:1788482887.098805:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573056 00000100:00100000:3.0:1788482887.098858:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788482887.098868:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:6491:x1875360098573056:12345-0@lo:101: 00010000:00010000:3.0:1788482887.098891:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482887.098903:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a346 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.098928:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.098939:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.098948:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528c00, rc 0) 00000100:00100000:3.0:1788482887.098984:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098573056:12345-0@lo:101: Request processed in 118us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.099001:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788482887.099332:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573056:0@lo:101: 00010000:00010000:0.0:1788482887.099349:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.099358:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482887.099416:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573184:0@lo:501: 00000100:00100000:0.0:1788482887.099442:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482887.099465:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.099533:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573184 00000100:00100000:3.0:1788482887.099538:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573184 00000100:00100000:3.0:1788482887.099570:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788482887.099577:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098573184:12345-0@lo:501: 00000100:00100000:3.0:1788482887.099682:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098573184:12345-0@lo:501: Request processed in 105us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.099688:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788482887.099756:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573184:0@lo:501: 00000100:00100000:0.0:1788482887.099793:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573312:0@lo:503: 00000100:00100000:0.0:1788482887.099837:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482887.099864:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.100012:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573312 00000100:00100000:3.0:1788482887.100017:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573312 00000100:00100000:3.0:1788482887.100043:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788482887.100050:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098573312:12345-0@lo:503: 00000100:00100000:3.0:1788482887.100152:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098573312:12345-0@lo:503: Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.100158:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788482887.100196:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573312:0@lo:503: 00000100:00100000:3.0:1788482887.100364:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8538:1875360098573440:0@lo:502: 00000100:00100000:3.0:1788482887.100396:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.100414:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573440 00000100:00100000:3.0:1788482887.100417:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573440 00000100:00100000:3.0:1788482887.100435:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788482887.100440:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8538:x1875360098573440:12345-0@lo:502: 00000100:00100000:3.0:1788482887.100516:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8538:x1875360098573440:12345-0@lo:502: Request processed in 75us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.100523:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788482887.100558:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.100569:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8538:1875360098573440:0@lo:502: 00000100:00100000:3.0:1788482887.100605:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8538:1875360098573568:0@lo:502: 00000100:00100000:3.0:1788482887.100633:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.100650:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573568 00000100:00100000:3.0:1788482887.100653:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573568 00000100:00100000:3.0:1788482887.100668:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788482887.100674:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8538:x1875360098573568:12345-0@lo:502: 00000100:00100000:3.0:1788482887.100727:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:8538:x1875360098573568:12345-0@lo:502: Request processed in 52us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.100747:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788482887.100784:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.100795:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8538:1875360098573568:0@lo:502: 00000040:00080000:3.0:1788482887.100814:0:8538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788482887.100861:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788482887.101227:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788482887.101236:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.101247:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482887.101257:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788482887.101259:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69c5051000 from 5 10000000:01000000:3.0:1788482887.101262:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788482887.101286:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.101303:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.101313:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482887.101326:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573696:0@lo:101: 00000100:00100000:3.0:1788482887.101355:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.101379:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482887.101488:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573696 00000100:00100000:0.0:1788482887.101493:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573696 00000100:00100000:0.0:1788482887.101526:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788482887.101533:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098573696:12345-0@lo:101: 00010000:00010000:0.0:1788482887.101541:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482887.101553:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a354 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.101571:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.101580:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.101588:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0031800, rc 0) 00000100:00100000:0.0:1788482887.101629:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098573696:12345-0@lo:101: Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.101635:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788482887.101724:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573696:0@lo:101: 00010000:00010000:1.0:1788482887.101756:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.101777:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482887.101819:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573824:0@lo:256: 00000100:00100000:1.0:1788482887.101849:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.101871:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.102021:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573824 00000100:00100000:3.0:1788482887.102026:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573824 00000100:00100000:3.0:1788482887.102059:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788482887.102066:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098573824:12345-0@lo:256: 20000000:01000000:3.0:1788482887.102079:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788482887.102124:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788482887.102128:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788482887.102202:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098573824:12345-0@lo:256: Request processed in 137us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.102210:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788482887.102315:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573824:0@lo:256: 10000000:01000000:1.0:1788482887.102361:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788482887.102367:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.102375:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482887.102382:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788482887.102384:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788482887.102386:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788482887.102401:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.102409:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.102416:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482887.102438:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573952:0@lo:101: 00000100:00100000:1.0:1788482887.102463:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.102492:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.102532:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098573952 00000100:00100000:3.0:1788482887.102536:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098573952 00000100:00100000:3.0:1788482887.102567:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788482887.102573:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098573952:12345-0@lo:101: 00010000:00010000:3.0:1788482887.102581:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482887.102591:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a362 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.102607:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.102622:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482887.102628:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529c00, rc 0) 00000100:00100000:3.0:1788482887.102739:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098573952:12345-0@lo:101: Request processed in 156us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.102745:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788482887.116582:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098573952:0@lo:101: 00010000:00010000:0.0:1788482887.116611:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.116625:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482887.116795:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574080:0@lo:501: 00000100:00100000:1.0:1788482887.116853:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.116898:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482887.117036:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574080 00000100:00100000:0.0:1788482887.117043:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574080 00000100:00100000:0.0:1788482887.117132:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788482887.117141:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098574080:12345-0@lo:501: 00000100:00100000:0.0:1788482887.117272:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098574080:12345-0@lo:501: Request processed in 132us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.117281:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788482887.117539:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574080:0@lo:501: 00000100:00100000:1.0:1788482887.117570:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574208:0@lo:503: 00000100:00100000:1.0:1788482887.117610:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.117635:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482887.117864:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574208 00000100:00100000:0.0:1788482887.117870:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574208 00000100:00100000:0.0:1788482887.117906:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788482887.117914:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098574208:12345-0@lo:503: 00000100:00100000:0.0:1788482887.118017:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098574208:12345-0@lo:503: Request processed in 104us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.118024:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788482887.118206:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574208:0@lo:503: 00000100:00100000:2.0:1788482887.130149:0:8540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8540:1875360098574336:0@lo:502: 00000100:00100000:2.0:1788482887.130234:0:8540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482887.130276:0:8540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece42180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482887.130352:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574336 00000100:00100000:0.0:1788482887.130361:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574336 00000100:00100000:0.0:1788482887.130402:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788482887.130411:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8540:x1875360098574336:12345-0@lo:502: 00000100:00100000:0.0:1788482887.130545:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8540:x1875360098574336:12345-0@lo:502: Request processed in 135us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.130553:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788482887.130651:0:8540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8540:1875360098574336:0@lo:502: 00000020:01000000:2.0:1788482887.130678:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788482887.130685:0:8540:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788482887.130692:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482887.130695:0:8540:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788482887.130699:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788482887.130703:0:8540:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:2.0:1788482887.130740:0:8540:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788482887.130744:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788482887.130771:0:8540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a69edaa3370) 00000020:00000080:2.0:1788482887.130796:0:8540:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788482887.130802:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788482887.130894:0:8540:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788482887.130900:0:8540:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788482887.130907:0:8540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1a377 00010000:00080000:2.0:1788482887.130939:0:8540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69efd14000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788482887.131202:0:8540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788482887.151906:0:8540:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788482887.151932:0:8540:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788482887.152230:0:8540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482887.152468:0:8540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482887.152553:0:8540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788482887.152635:0:8540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788482887.153374:0:8542:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788482887.153380:0:8542:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788482887.158817:0:8540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788482887.158893:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788482887.158954:0:8540:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788482887.158990:0:8540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1a37e 00000100:00080000:1.0:1788482887.159000:0:8540:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482887.159006:0:8540:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a69efd14000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482887.159051:0:8540:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e4700 x1875360098574464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788482887.159081:0:8540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788482887.159182:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482887.159199:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482887.159201:0:8540:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788482887.159205:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482887.159209:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482887.159210:0:8540:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788482887.159213:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788482887.159215:0:8540:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788482887.159251:0:8540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8540:1875360098574592:0@lo:502: 00000100:00100000:1.0:1788482887.159331:0:8540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.159365:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574592 00000100:00100000:1.0:1788482887.159371:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574592 00000100:00100000:1.0:1788482887.159407:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788482887.159415:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8540:x1875360098574592:12345-0@lo:502: 00000100:00100000:1.0:1788482887.159531:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:8540:x1875360098574592:12345-0@lo:502: Request processed in 115us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.159539:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788482887.159591:0:8540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.159611:0:8540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8540:1875360098574592:0@lo:502: 00000020:01000000:1.0:1788482887.159634:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482887.159638:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482887.159640:0:8540:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788482887.159644:0:8540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:0.0:1788482887.161125:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098574464:0@lo:8: 00000100:00100000:0.0:1788482887.161209:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788482887.161264:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788482887.161289:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788482887.161300:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.161313:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482887.161325:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788482887.161328:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69d20cc000 from 30 10000000:01000000:0.0:1788482887.161331:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788482887.161362:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.161371:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.161379:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482887.161395:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574720:0@lo:101: 00000100:00100000:0.0:1788482887.161421:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482887.161436:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.162318:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574464 00000100:00100000:1.0:1788482887.162328:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574464 00000100:00100000:1.0:1788482887.162366:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788482887.162375:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1875360098574464:12345-0@lo:8: 00010000:00080000:1.0:1788482887.162403:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1788482887.162431:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1a38c 00002000:00100000:1.0:1788482887.162469:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a68c2635800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788482887.162474:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788482887.162477:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788482887.162541:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788482887.162912:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574720 00000100:00100000:2.0:1788482887.162917:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574720 00000100:00100000:2.0:1788482887.162958:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788482887.162981:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098574720:12345-0@lo:101: 00010000:00010000:2.0:1788482887.162993:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482887.163008:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a385 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482887.163031:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482887.163040:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482887.163049:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0800, rc 0) 00000100:00100000:2.0:1788482887.163126:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098574720:12345-0@lo:101: Request processed in 147us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.163132:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00002000:00080000:1.0:1788482887.163888:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788482887.163918:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9a68c2631800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788482887.164040:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574720:0@lo:101: 00010000:00010000:2.0:1788482887.164062:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482887.164073:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482887.164172:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574848:0@lo:501: 00000100:00100000:2.0:1788482887.164294:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482887.164322:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482887.164344:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574848 00000100:00100000:2.0:1788482887.164349:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574848 00000100:00100000:2.0:1788482887.164382:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788482887.164389:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098574848:12345-0@lo:501: 00000100:00100000:2.0:1788482887.164505:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098574848:12345-0@lo:501: Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.164512:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788482887.164937:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098574464:12345-0@lo:8: Request processed in 2562us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.164947:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788482887.165148:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4700 x1875360098574464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788482897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482887.165159:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788482887.165166:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788482887.165173:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788482887.165178:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788482887.165181:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd14000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788482887.165908:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788482887.165917:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098574464:0@lo:8: 00000004:00080000:0.0:1788482887.166179:0:8542:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788482887.167931:0:8542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 179430831653ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788482887.167942:0:8542:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788482887.168038:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098574976:0@lo:700: 00000100:00100000:0.0:1788482887.168115:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482887.168154:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.169157:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098574976 00000100:00100000:1.0:1788482887.169168:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098574976 00000100:00100000:1.0:1788482887.169231:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788482887.169242:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8543:x1875360098574976:12345-0@lo:700: 00000100:00100000:1.0:1788482887.169290:0:8418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8418:1875360098575104:0@lo:700: 00000100:00100000:1.0:1788482887.169341:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.169375:0:8418:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9240 going to sleep for 11 seconds 00000100:00080000:0.0:1788482887.169891:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788482887.170092:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098575104 00000100:00100000:3.0:1788482887.170123:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098575104 00000100:00100000:3.0:1788482887.170177:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788482887.170185:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8418:x1875360098575104:12345-0@lo:700: 00000100:00100000:3.0:1788482887.170374:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098575232:0@lo:400: 00000100:00100000:3.0:1788482887.170420:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.170446:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098575744:0@lo:400: 00000100:00100000:3.0:1788482887.170466:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.170482:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482887.170488:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098575360:0@lo:400: 00000100:00100000:3.0:1788482887.170509:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.170536:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098575488:0@lo:400: 00000100:00100000:3.0:1788482887.170559:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.170576:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482887.170581:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098575616:0@lo:400: 00000100:00100000:3.0:1788482887.170600:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.170626:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098575360 00000100:00100000:3.0:1788482887.170630:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098575360 00000100:00100000:3.0:1788482887.170658:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098575616 00000100:00100000:3.0:1788482887.170670:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098575616 00000100:00100000:3.0:1788482887.170686:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788482887.170692:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098575360:12345-0@lo:400: 00000100:00100000:3.0:1788482887.170755:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098575360:12345-0@lo:400: Request processed in 62us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.170774:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788482887.170791:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788482887.170797:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098575616:12345-0@lo:400: 00000100:00100000:3.0:1788482887.170828:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098575616:12345-0@lo:400: Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.170834:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788482887.170851:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098575232 00000100:00100000:3.0:1788482887.170855:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098575232 00000100:00100000:3.0:1788482887.170873:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098575744 00000100:00100000:3.0:1788482887.170876:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098575744 00000100:00100000:3.0:1788482887.170888:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098575488 00000100:00100000:3.0:1788482887.170891:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098575488 00000100:00100000:3.0:1788482887.170902:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788482887.170908:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098575232:12345-0@lo:400: 00000100:00100000:3.0:1788482887.170935:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098575232:12345-0@lo:400: Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.170941:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788482887.170952:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482887.170957:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098575744:12345-0@lo:400: 00000100:00080000:0.0:1788482887.172161:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788482887.172168:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482887.172543:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788482887.172557:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098575488:12345-0@lo:400: 00000100:00100000:1.0:1788482887.172623:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098575488:12345-0@lo:400: Request processed in 72us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.172630:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788482887.174441:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098574848:0@lo:501: 00000100:00100000:2.0:1788482887.174498:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098575872:0@lo:503: 00000100:00100000:2.0:1788482887.174572:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482887.174612:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece42d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.175232:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098575744:12345-0@lo:400: Request processed in 4272us (4762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.175243:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482887.175293:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098575360:0@lo:400: 00010000:00080000:3.0:1788482887.175325:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f4754700 x1875360098575232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482887.175336:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098575232:0@lo:400: 00010000:00080000:3.0:1788482887.175347:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f4756d80 x1875360098575744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482887.175356:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098575744:0@lo:400: 00000100:00100000:3.0:1788482887.175395:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098575616:0@lo:400: 00010000:00080000:3.0:1788482887.175407:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f4755c00 x1875360098575488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482887.175415:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098575488:0@lo:400: 00000100:00100000:0.0:1788482887.176227:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098575872 00000100:00100000:0.0:1788482887.176238:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098575872 00000100:00100000:0.0:1788482887.176285:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788482887.176294:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098575872:12345-0@lo:503: 00000100:00100000:0.0:1788482887.176432:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098575872:12345-0@lo:503: Request processed in 138us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.176439:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788482887.177234:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098575872:0@lo:503: 00000004:00080000:3.0:1788482887.179614:0:7424:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788482887.187272:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8544:1875360098576000:0@lo:502: 00000100:00100000:1.0:1788482887.187354:0:8544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.187407:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482887.187457:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576000 00000100:00100000:2.0:1788482887.187465:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576000 00000100:00100000:2.0:1788482887.187513:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788482887.187522:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8544:x1875360098576000:12345-0@lo:502: 00000100:00100000:2.0:1788482887.187642:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8544:x1875360098576000:12345-0@lo:502: Request processed in 120us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.187649:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788482887.187839:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8544:1875360098576000:0@lo:502: 00000100:00100000:1.0:1788482887.187887:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8544:1875360098576128:0@lo:502: 00000100:00100000:1.0:1788482887.187919:0:8544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.187940:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482887.187987:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576128 00000100:00100000:2.0:1788482887.187993:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576128 00000100:00100000:2.0:1788482887.188032:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788482887.188038:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8544:x1875360098576128:12345-0@lo:502: 00000100:00100000:2.0:1788482887.188138:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:8544:x1875360098576128:12345-0@lo:502: Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.188154:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788482887.188353:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8544:1875360098576128:0@lo:502: 00000040:00080000:1.0:1788482887.188373:0:8544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 40000000:02000000:2.0:1788482887.188519:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:0.0:1788482887.188843:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788482887.188865:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788482887.188876:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.188887:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482887.188896:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788482887.188899:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69d20cc000 from 5 10000000:01000000:0.0:1788482887.188901:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788482887.188927:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.188935:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.188944:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482887.188968:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576256:0@lo:101: 00000100:00100000:0.0:1788482887.189004:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482887.189040:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.189115:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576256 00000100:00100000:1.0:1788482887.189120:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576256 00000100:00100000:1.0:1788482887.189161:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788482887.189169:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098576256:12345-0@lo:101: 00010000:00010000:1.0:1788482887.189178:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482887.189190:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a39a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.189211:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.189222:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.189231:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3200, rc 0) 00000100:00100000:1.0:1788482887.189265:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098576256:12345-0@lo:101: Request processed in 98us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.189272:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788482887.189303:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576256:0@lo:101: 00010000:00010000:1.0:1788482887.189315:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.189330:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482887.189370:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576384:0@lo:256: 00000100:00100000:1.0:1788482887.189397:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.189411:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.189422:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576384 00000100:00100000:1.0:1788482887.189426:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576384 00000100:00100000:1.0:1788482887.189445:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788482887.189451:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098576384:12345-0@lo:256: 20000000:01000000:1.0:1788482887.189463:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788482887.189480:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788482887.189483:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788482887.189561:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098576384:12345-0@lo:256: Request processed in 109us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.189569:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788482887.189753:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576384:0@lo:256: 10000000:01000000:0.0:1788482887.189807:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788482887.189814:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.189821:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482887.189828:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788482887.189830:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788482887.189832:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788482887.189848:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.189854:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482887.189861:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482887.189871:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576512:0@lo:101: 00000100:00100000:0.0:1788482887.189896:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482887.189926:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.189987:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576512 00000100:00100000:1.0:1788482887.189992:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576512 00000100:00100000:1.0:1788482887.190031:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788482887.190038:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098576512:12345-0@lo:101: 00010000:00010000:1.0:1788482887.190046:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482887.190056:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a3a8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.190070:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.190087:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.190116:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3800, rc 0) 00000100:00100000:1.0:1788482887.190147:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098576512:12345-0@lo:101: Request processed in 110us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.190154:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788482887.190181:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576512:0@lo:101: 00010000:00010000:1.0:1788482887.190191:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.190199:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482887.190244:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576640:0@lo:501: 00000100:00100000:1.0:1788482887.190269:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.190296:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482887.190444:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576640 00000100:00100000:0.0:1788482887.190456:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576640 00000100:00100000:0.0:1788482887.190486:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788482887.190493:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098576640:12345-0@lo:501: 00000100:00100000:0.0:1788482887.190597:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098576640:12345-0@lo:501: Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.190603:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788482887.190924:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576640:0@lo:501: 00000100:00100000:1.0:1788482887.190952:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576768:0@lo:503: 00000100:00100000:1.0:1788482887.191869:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.191889:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482887.192175:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576768 00000100:00100000:0.0:1788482887.192183:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576768 00000100:00100000:0.0:1788482887.192222:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788482887.192229:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098576768:12345-0@lo:503: 00000100:00100000:0.0:1788482887.192361:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098576768:12345-0@lo:503: Request processed in 117us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.192369:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788482887.192780:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098576768:0@lo:503: 00000100:00100000:1.0:1788482887.196468:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8546:1875360098576896:0@lo:502: 00000100:00100000:1.0:1788482887.196549:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.196608:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.196852:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098576896 00000100:00100000:3.0:1788482887.196860:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098576896 00000100:00100000:3.0:1788482887.196914:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788482887.196924:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:8546:x1875360098576896:12345-0@lo:502: 00000100:00100000:3.0:1788482887.197063:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:8546:x1875360098576896:12345-0@lo:502: Request processed in 140us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.197071:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788482887.197491:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8546:1875360098576896:0@lo:502: 00000020:01000000:1.0:1788482887.197520:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788482887.197528:0:8546:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788482887.197535:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482887.197537:0:8546:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788482887.197543:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788482887.197546:0:8546:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:1.0:1788482887.197566:0:8546:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788482887.197569:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788482887.197584:0:8546:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a69c55f0000) 00000020:00000080:1.0:1788482887.197605:0:8546:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788482887.197611:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788482887.197718:0:8546:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788482887.197737:0:8546:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788482887.197746:0:8546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a3bd 00010000:00080000:1.0:1788482887.197791:0:8546:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69efd40800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788482887.198044:0:8546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:2.0:1788482887.201055:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8418:x1875360098575104:12345-0@lo:700: Request processed in 30864us (31706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.201068:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788482887.201154:0:8418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4700 x1875360098575104/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482887.201167:0:8418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8418:1875360098575104:0@lo:700: 40000000:02000000:2.0:1788482887.201180:0:8418:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1788482887.213737:0:8546:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788482887.213773:0:8546:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788482887.213983:0:8546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482887.214215:0:8546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482887.214299:0:8546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788482887.214379:0:8546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788482887.215391:0:8547:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788482887.215397:0:8547:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788482887.216381:0:8546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788482887.216396:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788482887.216438:0:8546:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788482887.216462:0:8546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1a3c4 00000100:00080000:1.0:1788482887.216472:0:8546:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482887.216485:0:8546:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a69efd40800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482887.216518:0:8546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e6300 x1875360098577024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788482887.216579:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098577024:0@lo:8: 00000100:00100000:3.0:1788482887.216661:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.216752:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577024 00000100:00100000:1.0:1788482887.216792:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577024 00000100:00100000:1.0:1788482887.216822:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482887.216829:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098577024:12345-0@lo:8: 00010000:00080000:1.0:1788482887.216852:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1788482887.216878:0:8412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1a3cb 00002000:00100000:1.0:1788482887.216892:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a69efd45800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788482887.216896:0:8412:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788482887.216899:0:8412:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788482887.216978:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788482887.218389:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9a69efd47800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482887.230304:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098577024:12345-0@lo:8: Request processed in 13464us (13634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.230318:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788482887.230368:0:8546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788482887.230501:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482887.230508:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482887.230509:0:8546:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788482887.230512:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482887.230516:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482887.230517:0:8546:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788482887.230520:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788482887.230522:0:8546:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788482887.230561:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8546:1875360098577152:0@lo:502: 00000100:00100000:1.0:1788482887.230634:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.230670:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577152 00000100:00100000:1.0:1788482887.230678:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577152 00000100:00100000:1.0:1788482887.230719:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788482887.230744:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:8546:x1875360098577152:12345-0@lo:502: 00000100:00100000:1.0:1788482887.230871:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:8546:x1875360098577152:12345-0@lo:502: Request processed in 144us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.230877:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788482887.230915:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.230936:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:8546:1875360098577152:0@lo:502: 00000020:01000000:1.0:1788482887.230959:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482887.231253:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482887.231255:0:8546:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788482887.231259:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788482887.231312:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788482887.231329:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788482887.231339:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.231350:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482887.231359:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788482887.231362:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a69f45ecd28 from 1 10000000:01000000:1.0:1788482887.231365:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788482887.231390:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.231397:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.231416:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482887.231431:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098577280:0@lo:101: 00000100:00100000:1.0:1788482887.231462:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.231478:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.231494:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577280 00000100:00100000:1.0:1788482887.231497:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577280 00000100:00100000:1.0:1788482887.231523:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788482887.231530:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098577280:12345-0@lo:101: 00010000:00010000:1.0:1788482887.231538:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482887.231549:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a3d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.231570:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.231580:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.231589:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2e00, rc 0) 00000100:00100000:1.0:1788482887.231618:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098577280:12345-0@lo:101: Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.231625:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788482887.231657:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098577280:0@lo:101: 00010000:00010000:1.0:1788482887.231669:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.231688:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482887.232875:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098577408:0@lo:501: 00000100:00100000:1.0:1788482887.232920:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.232942:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.233174:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577408 00000100:00100000:1.0:1788482887.233180:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577408 00000100:00100000:1.0:1788482887.233219:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788482887.233227:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098577408:12345-0@lo:501: 00000100:00100000:1.0:1788482887.233309:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098577408:12345-0@lo:501: Request processed in 83us (388us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788482887.233316:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788482887.233355:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098577408:0@lo:501: 10000000:01000000:1.0:1788482887.233393:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788482887.233400:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482887.233410:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788482887.234154:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e6300 x1875360098577024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788482897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482887.234166:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482887.234174:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788482887.234190:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788482887.234195:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788482887.234199:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd40800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788482887.234211:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788482887.234217:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098577024:0@lo:8: 00000004:00080000:1.0:1788482887.234606:0:8547:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788482887.239651:0:8547:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 179502552825ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788482887.239660:0:8547:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:0.0:1788482887.241172:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788482887.241183:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788482887.241357:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8543:x1875360098574976:12345-0@lo:700: Request processed in 72112us (73236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.241374:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788482887.241457:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c1ca4e00 x1875360098574976/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482887.241471:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098574976:0@lo:700: 00000004:00080000:3.0:1788482887.249182:0:8549:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788482887.249216:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4756d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098577664:0@lo:7: 00000100:00100000:3.0:1788482887.249279:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482887.249333:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577664 00000100:00100000:3.0:1788482887.249344:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577664 00000100:00100000:3.0:1788482887.249397:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482887.249405:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8549:x1875360098577664:12345-0@lo:7: 00000100:00100000:2.0:1788482887.250930:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098577536:0@lo:13: 00000100:00100000:2.0:1788482887.250996:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788482887.251164:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482887.251180:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2780 going to sleep for 11 seconds 00000004:00080000:1.0:1788482887.253706:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788482887.256255:0:8543:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788482887.256298:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098577920:0@lo:7: 00000100:00100000:2.0:1788482887.256447:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098577792:0@lo:13: 00000100:00100000:2.0:1788482887.256489:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482887.256651:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577536 00000100:00100000:2.0:1788482887.256658:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577536 00000100:00100000:2.0:1788482887.256690:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577792 00000100:00100000:2.0:1788482887.256693:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577792 00000100:00100000:2.0:1788482887.256707:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482887.256714:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098577536:12345-0@lo:13: 00002000:00000024:2.0:1788482887.256749:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923836928 avail 3692314624 00000100:00100000:2.0:1788482887.256806:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098577536:12345-0@lo:13: Request processed in 91us (5809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.256819:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482887.256837:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788482887.256843:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098577792:12345-0@lo:13: 00002000:00000024:2.0:1788482887.256854:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923836928 avail 3692314624 00000100:00100000:2.0:1788482887.256883:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098577792:12345-0@lo:13: Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.256889:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788482887.256920:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4e00 x1875360098577792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482887.256939:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098577792:0@lo:13: 00010000:00080000:2.0:1788482887.257059:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f4754380 x1875360098577536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482887.257074:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098577536:0@lo:13: 00000100:00100000:1.0:1788482887.257212:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.257240:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdab300 going to sleep for 11 seconds 00000100:00100000:2.0:1788482887.259863:0:8409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788482887.259873:0:8409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788482887.260264:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098577920 00000100:00100000:1.0:1788482887.260273:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098577920 00000100:00100000:2.0:1788482887.260488:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482887.260497:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8543:x1875360098577920:12345-0@lo:7: 00002000:00080000:3.0:1788482887.262151:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788482887.262159:0:8411:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788482887.262251:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8549:x1875360098577664:12345-0@lo:7: Request processed in 12843us (12968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482887.262261:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788482887.264513:0:8549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f4756d80 x1875360098577664/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482887.264531:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4756d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098577664:0@lo:7: 00000004:00080000:1.0:1788482887.264545:0:8549:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788482887.264585:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098578048:0@lo:5: 00000100:00100000:1.0:1788482887.264635:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.264662:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdabc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.264681:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578048 00000100:00100000:1.0:1788482887.264687:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578048 00000100:00100000:1.0:1788482887.264751:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788482887.264771:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8549:x1875360098578048:12345-0@lo:5: 00002000:00080000:1.0:1788482887.264796:0:8409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788482887.264800:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1788482887.281186:0:8551:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788482887.281194:0:8551:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788482887.281280:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8543:x1875360098577920:12345-0@lo:7: Request processed in 20780us (24064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.281289:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482887.281336:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8549:x1875360098578048:12345-0@lo:5: Request processed in 16576us (16699us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788482887.281342:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788482887.281363:0:8549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e7b80 x1875360098578048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482887.281383:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098578048:0@lo:5: 00000004:00080000:2.0:1788482887.281405:0:8549:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788482887.281441:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f39180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098578176:0@lo:700: 00000100:00100000:2.0:1788482887.281473:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482887.281506:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482887.281784:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578176 00000100:00100000:3.0:1788482887.281791:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578176 00000100:00100000:3.0:1788482887.281838:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788482887.281848:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8549:x1875360098578176:12345-0@lo:700: 00010000:00080000:0.0:1788482887.287567:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4a80 x1875360098577920/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482887.287586:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098577920:0@lo:7: 00000004:00080000:0.0:1788482887.287600:0:8543:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788482887.287638:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098578304:0@lo:5: 00000100:00100000:0.0:1788482887.287693:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788482887.287889:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1788482887.287981:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8549:x1875360098578176:12345-0@lo:700: Request processed in 6134us (6506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.287991:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788482887.288041:0:8549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69d0f39180 x1875360098578176/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482887.288051:0:8549:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788482887.288061:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f39180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098578176:0@lo:700: 00000100:00100000:0.0:1788482887.288687:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f900 going to sleep for 11 seconds 00000004:02000040:1.0:1788482887.291897:0:8549:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788482887.302865:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578304 00000100:00100000:2.0:1788482887.302885:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578304 00000100:00100000:2.0:1788482887.302955:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482887.302965:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8543:x1875360098578304:12345-0@lo:5: 00002000:00080000:2.0:1788482887.303006:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788482887.303092:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8543:x1875360098578304:12345-0@lo:5: Request processed in 129us (15399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482887.303114:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788482887.306774:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c1ca4e00 x1875360098578304/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482887.306793:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098578304:0@lo:5: 00000004:00080000:2.0:1788482887.306810:0:8543:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788482887.306853:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098578432:0@lo:5: 00000100:00100000:2.0:1788482887.306916:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482887.306952:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482887.306971:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578432 00000100:00100000:2.0:1788482887.306976:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578432 00000100:00100000:2.0:1788482887.307025:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788482887.307034:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8543:x1875360098578432:12345-0@lo:5: 00002000:00080000:2.0:1788482887.307070:0:8551:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788482887.307628:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098578560:0@lo:5: 00000100:00100000:1.0:1788482887.307659:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.307677:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482887.307689:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578560 00000100:00100000:1.0:1788482887.307694:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578560 00000100:00100000:1.0:1788482887.307721:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788482887.307741:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8549:x1875360098578560:12345-0@lo:5: 00000100:00100000:2.0:1788482887.309998:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8543:x1875360098578432:12345-0@lo:5: Request processed in 2959us (3076us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788482887.310016:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788482887.310071:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69d0f3a300 x1875360098578432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482887.310087:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8543:1875360098578432:0@lo:5: 00000004:00080000:2.0:1788482887.310127:0:8543:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788482887.310165:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8543:1875360098578688:0@lo:900: 00000100:00100000:2.0:1788482887.310197:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482887.310221:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482887.316495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578688 00000100:00100000:0.0:1788482887.316514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578688 00000100:00100000:0.0:1788482887.316566:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482887.316576:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8543:x1875360098578688:12345-0@lo:900: 00000100:00100000:0.0:1788482887.316671:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8543:x1875360098578688:12345-0@lo:900: Request processed in 97us (6473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482887.316678:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788482887.316722:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69d0f38a80 x1875360098578688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482887.316752:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8543:1875360098578688:0@lo:900: 00002000:00080000:1.0:1788482887.321665:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788482887.321683:0:8412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788482887.345195:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8549:x1875360098578560:12345-0@lo:5: Request processed in 37450us (37528us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788482887.345210:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788482887.347026:0:8549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e7b80 x1875360098578560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482903 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482887.347050:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8549:1875360098578560:0@lo:5: 00000004:00080000:2.0:1788482887.347066:0:8549:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1788482887.421706:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098578816:0@lo:41: 00000100:00100000:1.0:1788482887.421802:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482887.421888:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578816 00000100:00100000:1.0:1788482887.421896:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578816 00000100:00100000:1.0:1788482887.421937:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482887.421945:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098578816:12345-0@lo:41: 00000004:00000024:1.0:1788482887.422181:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788482887.422226:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098578816:12345-0@lo:41: Request processed in 281us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482887.422232:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482887.422275:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098578816:0@lo:41: 00010000:00010000:3.0:1788482887.800600:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482888.825329:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482889.853213:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482889.978011:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788482889.978035:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098578944:0@lo:41: 00000100:00100000:1.0:1788482889.978125:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482889.978185:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098578944 00000100:00100000:1.0:1788482889.978192:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098578944 00000100:00100000:1.0:1788482889.978234:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482889.978242:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098578944:12345-0@lo:41: 00000004:00000024:1.0:1788482889.978285:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788482889.978772:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098578944:12345-0@lo:41: Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482889.978783:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482889.978836:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098578944:0@lo:41: 00010000:00010000:3.0:1788482890.873724:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482891.900669:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788482892.274015:0:8787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788482892.549238:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098579072:0@lo:13: 00000100:00100000:3.0:1788482892.549313:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482892.549388:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579072 00000100:00100000:3.0:1788482892.549395:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579072 00000100:00100000:3.0:1788482892.549445:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482892.549455:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098579072:12345-0@lo:13: 00002000:00000024:3.0:1788482892.549496:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482892.549540:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098579072:12345-0@lo:13: Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482892.549547:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788482892.549567:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788482892.549595:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f4757100 x1875360098579072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482892.549613:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098579072:0@lo:13: 00000100:00100000:1.0:1788482892.551043:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098579200:0@lo:400: 00000100:00100000:1.0:1788482892.551118:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482892.551151:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098579712:0@lo:400: 00000100:00100000:1.0:1788482892.551175:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482892.551197:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788482892.551202:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098579328:0@lo:400: 00000100:00100000:1.0:1788482892.551225:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482892.551241:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098579840:0@lo:400: 00000100:00100000:1.0:1788482892.551257:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482892.551364:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579200 00000100:00100000:1.0:1788482892.551370:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579200 00000100:00100000:1.0:1788482892.551406:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788482892.551414:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3621:x1875360098579200:12345-0@lo:400: 00000100:00100000:1.0:1788482892.551460:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3621:x1875360098579200:12345-0@lo:400: Request processed in 47us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482892.551466:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788482892.551659:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098579456:0@lo:400: 00000100:00100000:3.0:1788482892.551690:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482892.551710:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098579968:0@lo:400: 00000100:00100000:3.0:1788482892.551740:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482892.551769:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788482892.551775:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098579584:0@lo:400: 00000100:00100000:3.0:1788482892.551797:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482892.551814:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098580096:0@lo:400: 00000100:00100000:3.0:1788482892.551840:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482892.551877:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579328 00000100:00100000:3.0:1788482892.551881:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579328 00000100:00100000:3.0:1788482892.551904:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579840 00000100:00100000:3.0:1788482892.551907:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579840 00000100:00100000:3.0:1788482892.551926:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579968 00000100:00100000:3.0:1788482892.551938:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579968 00000100:00100000:3.0:1788482892.551954:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579584 00000100:00100000:3.0:1788482892.551956:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579584 00000100:00100000:3.0:1788482892.551968:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788482892.551975:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098579328:12345-0@lo:400: 00000100:00100000:3.0:1788482892.552009:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098579328:12345-0@lo:400: Request processed in 35us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482892.552014:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788482892.552026:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788482892.552032:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098579840:12345-0@lo:400: 00000100:00100000:3.0:1788482892.552058:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098579840:12345-0@lo:400: Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482892.552063:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788482892.552073:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482892.552078:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098579968:12345-0@lo:400: 00000100:00100000:3.0:1788482892.552125:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098579968:12345-0@lo:400: Request processed in 46us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482892.552131:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482892.552141:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788482892.552147:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098579584:12345-0@lo:400: 00000100:00100000:3.0:1788482892.552171:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098579584:12345-0@lo:400: Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482892.552176:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788482892.552191:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788482892.552194:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788482892.552216:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4a80 x1875360098579584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482892.552241:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098579584:0@lo:400: 00010000:00080000:3.0:1788482892.552254:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e6300 x1875360098579968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482892.552261:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098579968:0@lo:400: 00000100:00100000:1.0:1788482892.554932:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579712 00000100:00100000:1.0:1788482892.554945:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579712 00000100:00100000:1.0:1788482892.554984:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098579456 00000100:00100000:1.0:1788482892.554999:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098579456 00000100:00100000:1.0:1788482892.555019:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482892.555028:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098579712:12345-0@lo:400: 00000100:00100000:1.0:1788482892.555117:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098579712:12345-0@lo:400: Request processed in 90us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482892.555124:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482892.555141:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482892.555146:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098579456:12345-0@lo:400: 00000100:00100000:1.0:1788482892.555183:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098579456:12345-0@lo:400: Request processed in 37us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482892.555189:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482892.555246:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098579456:0@lo:400: 00000100:00100000:1.0:1788482892.555269:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482892.555279:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098580224:0@lo:41: 00000100:00100000:1.0:1788482892.555308:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482892.555335:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580224 00000100:00100000:1.0:1788482892.555338:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580224 00000100:00100000:1.0:1788482892.555358:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788482892.555364:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098580224:12345-0@lo:41: 00000004:00000024:1.0:1788482892.555385:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788482892.555418:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098580224:12345-0@lo:41: Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482892.555423:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788482892.555453:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098580224:0@lo:41: 00000100:00100000:2.0:1788482892.557627:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580096 00000100:00100000:2.0:1788482892.557639:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580096 00000100:00100000:2.0:1788482892.557693:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482892.557702:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1875360098580096:12345-0@lo:400: 00000100:00080000:3.0:1788482892.557809:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788482892.559641:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1788482892.559658:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1788482892.560567:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098580352:0@lo:13: 00000100:00100000:0.0:1788482892.560631:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482892.561997:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580352 00000100:00100000:3.0:1788482892.562007:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580352 00000100:00100000:3.0:1788482892.562064:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482892.562074:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098580352:12345-0@lo:13: 00002000:00000024:3.0:1788482892.562123:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482892.562190:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098580352:12345-0@lo:13: Request processed in 118us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482892.562198:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788482892.562239:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c1ca7100 x1875360098580352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482892.562250:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788482892.562272:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098580352:0@lo:13: 00000100:00100000:2.0:1788482892.562651:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098580096:12345-0@lo:400: Request processed in 4947us (10807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482892.562661:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788482892.565349:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4000 x1875360098579328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482892.565368:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098579328:0@lo:400: 00010000:00080000:0.0:1788482892.565384:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4700 x1875360098579840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482892.565392:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098579840:0@lo:400: 00000100:00100000:0.0:1788482892.565402:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098579200:0@lo:400: 00000100:00100000:0.0:1788482892.565412:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098579712:0@lo:400: 00010000:00080000:1.0:1788482892.565916:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd934380 x1875360098580096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482892.565941:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098580096:0@lo:400: 00010000:00010000:2.0:1788482892.929256:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788482893.347752:0:8840:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788482893.348029:0:8840:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788482893.945481:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482894.968572:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482895.096526:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482895.096551:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098580480:0@lo:41: 00000100:00100000:3.0:1788482895.096625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482895.097823:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580480 00000100:00100000:1.0:1788482895.097833:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580480 00000100:00100000:1.0:1788482895.097895:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788482895.097906:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098580480:12345-0@lo:41: 00000004:00000024:1.0:1788482895.097940:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788482895.098012:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098580480:12345-0@lo:41: Request processed in 107us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482895.098020:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788482895.098145:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098580480:0@lo:41: 00010000:00010000:3.0:1788482895.993029:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788482896.133744:0:8941:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788482896.134015:0:8941:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788482896.994929:0:8989:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482896.994940:0:8989:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788482897.018155:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482897.657454:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098580608:0@lo:13: 00000100:00100000:0.0:1788482897.657525:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482897.657604:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580608 00000100:00100000:0.0:1788482897.657612:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580608 00000100:00100000:0.0:1788482897.657664:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482897.657674:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098580608:12345-0@lo:13: 00002000:00000024:0.0:1788482897.657713:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482897.657757:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098580608:12345-0@lo:13: Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482897.657764:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788482897.657784:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482897.657814:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c1ca4700 x1875360098580608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482897.657832:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098580608:0@lo:13: 00000100:00100000:1.0:1788482897.659083:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098580736:0@lo:400: 00000100:00100000:1.0:1788482897.659154:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482897.659187:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098581248:0@lo:400: 00000100:00100000:1.0:1788482897.659210:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482897.659230:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788482897.659236:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098580864:0@lo:400: 00000100:00100000:1.0:1788482897.659259:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482897.659275:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098581376:0@lo:400: 00000100:00100000:1.0:1788482897.659296:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482897.660429:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580736 00000100:00100000:1.0:1788482897.660439:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580736 00000100:00100000:1.0:1788482897.660494:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788482897.660504:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3621:x1875360098580736:12345-0@lo:400: 00000100:00100000:1.0:1788482897.660758:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3621:x1875360098580736:12345-0@lo:400: Request processed in 255us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482897.660766:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788482897.660819:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098581248 00000100:00100000:1.0:1788482897.660824:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098581248 00000100:00100000:1.0:1788482897.660849:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788482897.660856:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098581248:12345-0@lo:400: 00000100:00100000:1.0:1788482897.660893:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098581248:12345-0@lo:400: Request processed in 38us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482897.660899:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788482897.660917:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580864 00000100:00100000:1.0:1788482897.660921:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580864 00000100:00100000:1.0:1788482897.660941:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098581376 00000100:00100000:1.0:1788482897.660944:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098581376 00000100:00100000:1.0:1788482897.660973:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788482897.660979:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098580864:12345-0@lo:400: 00000100:00100000:1.0:1788482897.661011:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098580864:12345-0@lo:400: Request processed in 32us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482897.661017:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788482897.661027:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788482897.661033:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098581376:12345-0@lo:400: 00000100:00100000:1.0:1788482897.661059:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098581376:12345-0@lo:400: Request processed in 26us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482897.661064:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788482897.662185:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098580992:0@lo:400: 00000100:00100000:0.0:1788482897.662231:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482897.662263:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098581504:0@lo:400: 00000100:00100000:0.0:1788482897.662291:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482897.662311:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788482897.662331:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098581120:0@lo:400: 00000100:00100000:0.0:1788482897.662354:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482897.662371:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098581632:0@lo:400: 00000100:00100000:0.0:1788482897.662408:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482897.662438:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098581632 00000100:00100000:0.0:1788482897.662443:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098581632 00000100:00100000:0.0:1788482897.662687:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482897.662696:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098581632:12345-0@lo:400: 00000100:00100000:0.0:1788482897.662747:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098581632:12345-0@lo:400: Request processed in 53us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482897.662754:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788482897.662885:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd935880 x1875360098581632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482897.662895:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788482897.662912:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098581632:0@lo:400: 00000100:00100000:2.0:1788482897.663038:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098580992 00000100:00100000:2.0:1788482897.663043:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098580992 00000100:00100000:2.0:1788482897.663078:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788482897.663093:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098580992:12345-0@lo:400: 00000100:00100000:2.0:1788482897.663152:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098580992:12345-0@lo:400: Request processed in 61us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482897.663158:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788482897.665869:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd935500 x1875360098580864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482897.665887:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098580864:0@lo:400: 00010000:00080000:1.0:1788482897.665917:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd936300 x1875360098581376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482897.665925:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098581376:0@lo:400: 00000100:00100000:2.0:1788482897.665944:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098581504 00000100:00100000:2.0:1788482897.665952:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098581504 00000100:00100000:1.0:1788482897.665952:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098580736:0@lo:400: 00000100:00100000:1.0:1788482897.665963:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098581248:0@lo:400: 00000100:00100000:2.0:1788482897.665990:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098581120 00000100:00100000:1.0:1788482897.665990:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098581760:0@lo:41: 00000100:00100000:2.0:1788482897.665992:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098581120 00000100:00100000:2.0:1788482897.666006:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788482897.666013:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098581504:12345-0@lo:400: 00000100:00100000:1.0:1788482897.666038:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482897.666057:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098581504:12345-0@lo:400: Request processed in 45us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482897.666063:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788482897.666070:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482897.666075:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098581888:0@lo:13: 00000100:00100000:2.0:1788482897.666078:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788482897.666083:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098581120:12345-0@lo:400: 00000100:00100000:1.0:1788482897.666112:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482897.666124:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098581120:12345-0@lo:400: Request processed in 41us (3770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482897.666130:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788482897.666147:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788482897.666147:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098581760 00000100:00100000:1.0:1788482897.666150:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098581760 00000100:00080000:2.0:1788482897.666152:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482897.666154:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482897.666179:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788482897.666185:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098581760:12345-0@lo:41: 00000004:00000024:1.0:1788482897.666209:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788482897.666253:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098581760:12345-0@lo:41: Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482897.666259:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788482897.666281:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098581888 00000100:00100000:1.0:1788482897.666284:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098581888 00000100:00100000:1.0:1788482897.666304:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788482897.666310:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098581888:12345-0@lo:13: 00010000:00080000:0.0:1788482897.666335:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd937b80 x1875360098581120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482897.666349:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098581120:0@lo:400: 00000100:00100000:0.0:1788482897.666362:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098580992:0@lo:400: 00010000:00080000:0.0:1788482897.666372:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd934e00 x1875360098581504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482897.666389:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098581504:0@lo:400: 00000100:00100000:2.0:1788482897.666454:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098581760:0@lo:41: 00002000:00000024:1.0:1788482897.667403:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482897.667468:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098581888:12345-0@lo:13: Request processed in 1157us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482897.667476:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788482897.667569:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69d0f3a300 x1875360098581888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482897.667586:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098581888:0@lo:13: 00010000:00010000:0.0:1788482898.040303:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482899.069524:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482900.088449:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482900.220000:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098582016:0@lo:41: 00000100:00100000:0.0:1788482900.220069:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482900.220165:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582016 00000100:00100000:0.0:1788482900.220173:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582016 00000100:00100000:0.0:1788482900.220219:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482900.220235:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098582016:12345-0@lo:41: 00000004:00000024:0.0:1788482900.220265:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788482900.220307:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098582016:12345-0@lo:41: Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482900.220313:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482900.220353:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098582016:0@lo:41: 00010000:00010000:0.0:1788482901.112307:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482902.137298:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482902.776647:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098582144:0@lo:13: 00000100:00100000:0.0:1788482902.776717:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.782038:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582144 00000100:00100000:0.0:1788482902.782053:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582144 00000100:00100000:0.0:1788482902.782136:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788482902.782147:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098582144:12345-0@lo:13: 00002000:00000024:0.0:1788482902.782187:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482902.782263:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098582144:12345-0@lo:13: Request processed in 118us (5545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482902.782270:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788482902.782297:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482902.782343:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c1ca4700 x1875360098582144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482902.782361:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098582144:0@lo:13: 00000100:00100000:2.0:1788482902.782794:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098582272:0@lo:41: 00000100:00100000:2.0:1788482902.782841:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482902.782889:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582272 00000100:00100000:2.0:1788482902.782893:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582272 00000100:00100000:2.0:1788482902.782922:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788482902.782929:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098582272:12345-0@lo:41: 00000004:00000024:2.0:1788482902.782951:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788482902.782983:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098582272:12345-0@lo:41: Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482902.782989:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788482902.783019:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098582272:0@lo:41: 00000100:00100000:0.0:1788482902.783275:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098582528:0@lo:400: 00000100:00100000:0.0:1788482902.783306:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783332:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098583040:0@lo:400: 00000100:00100000:0.0:1788482902.783368:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783393:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788482902.783399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098582656:0@lo:400: 00000100:00100000:0.0:1788482902.783421:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783434:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098583168:0@lo:400: 00000100:00100000:0.0:1788482902.783451:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783481:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098582400:0@lo:13: 00000100:00100000:0.0:1788482902.783522:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783539:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098582912:0@lo:400: 00000100:00100000:0.0:1788482902.783559:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783575:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788482902.783580:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098582784:0@lo:400: 00000100:00100000:0.0:1788482902.783602:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783615:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098583296:0@lo:400: 00000100:00100000:0.0:1788482902.783633:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482902.783659:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582784 00000100:00100000:0.0:1788482902.783695:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582784 00000100:00100000:0.0:1788482902.783722:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482902.783729:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098582784:12345-0@lo:400: 00000100:00100000:0.0:1788482902.783766:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098582784:12345-0@lo:400: Request processed in 38us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482902.783773:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482902.783791:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583296 00000100:00100000:0.0:1788482902.783795:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583296 00000100:00100000:0.0:1788482902.783823:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788482902.783829:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098583296:12345-0@lo:400: 00000100:00100000:0.0:1788482902.784049:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098583296:12345-0@lo:400: Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482902.784069:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788482902.784141:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482902.784163:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098582784:0@lo:400: 00010000:00080000:0.0:1788482902.784333:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69ecc27480 x1875360098583296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482902.784344:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098583296:0@lo:400: 00000100:00100000:0.0:1788482902.784543:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582400 00000100:00100000:0.0:1788482902.784548:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582400 00000100:00100000:0.0:1788482902.784578:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482902.784585:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098582400:12345-0@lo:13: 00002000:00000024:0.0:1788482902.784598:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482902.784637:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098582400:12345-0@lo:13: Request processed in 54us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482902.784642:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788482902.785468:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c1ca4700 x1875360098582400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482902.785497:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098582400:0@lo:13: 00000100:00100000:0.0:1788482902.785572:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582528 00000100:00100000:0.0:1788482902.785576:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582528 00000100:00100000:0.0:1788482902.785604:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788482902.785610:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3619:x1875360098582528:12345-0@lo:400: 00000100:00100000:2.0:1788482902.785761:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583040 00000100:00100000:2.0:1788482902.785765:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583040 00000100:00100000:2.0:1788482902.785795:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582656 00000100:00100000:2.0:1788482902.785797:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582656 00000100:00100000:2.0:1788482902.785807:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583168 00000100:00100000:2.0:1788482902.785809:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583168 00000100:00100000:2.0:1788482902.785818:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098582912 00000100:00100000:2.0:1788482902.785821:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098582912 00000100:00100000:2.0:1788482902.785831:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482902.785836:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098583040:12345-0@lo:400: 00000100:00100000:0.0:1788482902.785891:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3619:x1875360098582528:12345-0@lo:400: Request processed in 281us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482902.785898:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788482902.789215:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098583040:12345-0@lo:400: Request processed in 3369us (5837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482902.789229:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482902.789263:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482902.789277:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098582656:12345-0@lo:400: 00000100:00100000:2.0:1788482902.789343:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098582656:12345-0@lo:400: Request processed in 73us (5921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482902.789349:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482902.789374:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482902.789381:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098583168:12345-0@lo:400: 00000100:00100000:2.0:1788482902.789413:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098583168:12345-0@lo:400: Request processed in 33us (5960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482902.789418:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482902.789430:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788482902.789437:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098582912:12345-0@lo:400: 00000100:00100000:2.0:1788482902.789481:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098582912:12345-0@lo:400: Request processed in 45us (5921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482902.789486:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788482902.789536:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788482902.789540:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788482902.789575:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69ecc24e00 x1875360098582912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482902.789589:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098582912:0@lo:400: 00000100:00100000:0.0:1788482902.791130:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098582528:0@lo:400: 00010000:00080000:0.0:1788482902.791226:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69ecc24380 x1875360098583040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482902.791238:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098583040:0@lo:400: 00010000:00080000:0.0:1788482902.791272:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c1ca6680 x1875360098582656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482902.791281:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098582656:0@lo:400: 00010000:00080000:0.0:1788482902.791293:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69ecc26680 x1875360098583168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482902.791300:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098583168:0@lo:400: 00010000:00010000:3.0:1788482903.160397:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482904.185250:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482905.209273:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482905.336414:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482905.339120:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098583424:0@lo:41: 00000100:00100000:3.0:1788482905.339194:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482905.339658:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583424 00000100:00100000:2.0:1788482905.339677:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583424 00000100:00100000:2.0:1788482905.339732:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788482905.339742:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098583424:12345-0@lo:41: 00000004:00000024:2.0:1788482905.339795:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788482905.339852:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098583424:12345-0@lo:41: Request processed in 111us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482905.339858:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788482905.340082:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098583424:0@lo:41: 00010000:00010000:2.0:1788482906.232350:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482907.259673:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788482907.505136:0:9488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788482907.505140:0:9488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788482907.505142:0:9488:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788482907.505278:0:9488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a68c1c41000 00000020:01000004:3.0:1788482907.505293:0:9488:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788482907.505306:0:9488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788482907.505319:0:9488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a69f6158000) 00000020:00000080:3.0:1788482907.505345:0:9488:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788482907.573650:0:9488:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788482907.573716:0:9488:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788482907.615582:0:9488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788482907.615801:0:9488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788482907.615813:0:9488:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788482907.615823:0:9488:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d7ea3d89ea1a3e7 00000020:01000004:3.0:1788482907.615831:0:9488:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788482907.615849:0:9488:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788482907.615852:0:9488:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788482907.615856:0:9488:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788482907.615879:0:9488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788482907.615884:0:9488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788482907.650675:0:9488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788482907.650719:0:9488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.154@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788482907.650723:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788482907.650725:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788482907.650726:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482907.650727:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482907.650729:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482907.650730:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482907.650732:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788482907.650733:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482907.650734:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482907.650736:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482907.650737:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788482907.650741:0:9488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788482907.650744:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788482907.650745:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788482907.650746:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482907.650747:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482907.650748:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482907.650749:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482907.650750:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788482907.650751:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482907.650752:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482907.650753:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482907.650753:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788482907.650780:0:9488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788482907.650800:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098583552:0@lo:253: 00000100:00100000:2.0:1788482907.650878:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.650938:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61240 going to sleep for 11 seconds 00000100:00100000:1.0:1788482907.650955:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583552 00000100:00100000:1.0:1788482907.650963:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583552 00000100:00100000:1.0:1788482907.651062:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788482907.651079:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:9488:x1875360098583552:12345-0@lo:253: 20000000:01000000:1.0:1788482907.651164:0:6487:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788482907.651169:0:6487:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788482907.651173:0:6487:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788482907.651192:0:6487:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788482907.651445:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482907.651571:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788482907.651586:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788482907.651604:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788482907.651610:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788482907.651636:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788482907.651666:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788482907.651748:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788482907.651761:0:6487:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.154@tcp 20000000:01000000:1.0:1788482907.651763:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788482907.651777:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788482907.651782:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788482907.651793:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788482907.651797:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:1.0:1788482907.651808:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788482907.651815:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788482907.651826:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788482907.651839:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788482907.652833:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788482907.653170:0:6487:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.154@tcp 20000000:01000000:1.0:1788482907.653173:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788482907.653286:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788482907.653296:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788482907.653311:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788482907.653317:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:1.0:1788482907.653330:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788482907.653353:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788482907.653368:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788482907.653382:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788482907.655082:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788482907.655206:0:6487:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.154@tcp 20000000:01000000:1.0:1788482907.655209:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788482907.655228:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788482907.655236:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788482907.655249:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788482907.655255:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.154@tcp (null) (null) 00000040:00080000:1.0:1788482907.655271:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788482907.655279:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788482907.655292:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788482907.655306:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788482907.655320:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788482907.655323:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788482907.655326:0:6487:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788482907.655369:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788482907.655372:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788482907.657795:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788482907.657842:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788482907.657860:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788482907.658039:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788482907.658061:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788482907.658076:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788482907.658087:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788482907.658090:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788482907.658646:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788482907.658810:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788482907.658832:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788482907.658846:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788482907.658855:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788482907.658857:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788482907.659221:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788482907.659242:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788482907.659257:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788482907.659420:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788482907.659451:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788482907.659467:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788482907.659476:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788482907.659478:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788482907.660240:0:9497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788482907.660267:0:9497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788482907.660283:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788482907.660410:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788482907.660430:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788482907.660445:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788482907.660455:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788482907.660457:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788482907.661075:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788482907.661422:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788482907.661437:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788482907.661824:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788482907.661845:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788482907.661860:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:2.0:1788482907.661874:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788482907.661957:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.661974:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.661981:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.661989:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.661996:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662002:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662008:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662024:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662032:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662069:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662085:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 21 pid: 6486 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.662188:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f51500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098583680:0@lo:104: 00000100:00100000:2.0:1788482907.662310:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482907.662411:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662420:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 21 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.662429:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098583808:0@lo:104: 00000100:00100000:2.0:1788482907.662449:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482907.662552:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662560:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.662569:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098583936:0@lo:104: 00000100:00100000:1.0:1788482907.662681:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583680 00000100:00100000:0.0:1788482907.662717:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583808 00000100:00100000:0.0:1788482907.662725:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583808 00000100:00100000:0.0:1788482907.662762:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788482907.662764:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583680 00000100:00100000:0.0:1788482907.662773:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6487:x1875360098583808:12345-0@lo:104: 00010000:00010000:0.0:1788482907.662788:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.662812:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482907.662853:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.662863:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.662871:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584064:0@lo:104: 00010000:00010000:0.0:1788482907.662910:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482907.662917:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6487:x1875360098583808:12345-0@lo:104: Request processed in 147us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482907.662924:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788482907.662939:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098583936 00000100:00100000:0.0:1788482907.662942:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098583936 00000100:00100000:0.0:1788482907.662954:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788482907.662966:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6487:x1875360098583680:12345-0@lo:104: 00010000:00010000:0.0:1788482907.662973:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.664818:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482907.664832:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.665419:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482907.665424:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.665433:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482907.665439:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482907.665445:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482907.665496:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.665503:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482907.665525:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.665531:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0030e00/0x1d7ea3d89ea1a3a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.665549:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482907.665551:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482907.665553:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482907.665570:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098584192:0@lo:103: 00000100:00100000:2.0:1788482907.666090:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482907.666129:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482907.666140:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6487:x1875360098583680:12345-0@lo:104: Request processed in 3172us (3828us total) trans 0 rc 0/0 00010000:00010000:2.0:1788482907.666144:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482907.666152:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482907.666152:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788482907.666164:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788482907.666168:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.666176:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482907.666183:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482907.666189:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482907.666324:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.666331:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482907.666338:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.666361:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a3d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.666373:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482907.666374:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482907.666376:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482907.666414:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.666428:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 21 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.666438:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584448:0@lo:104: 00000100:00100000:2.0:1788482907.666466:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482907.666681:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482907.666751:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584064 00000100:00100000:1.0:1788482907.666759:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584064 00010000:00010000:2.0:1788482907.666772:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.666784:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584576:0@lo:104: 00000100:00100000:1.0:1788482907.666793:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584448 00000100:00100000:1.0:1788482907.666797:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584448 00000100:00100000:1.0:1788482907.666816:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788482907.666821:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.666830:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6487:x1875360098583936:12345-0@lo:104: 00010000:00010000:1.0:1788482907.666842:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.666846:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.666855:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.666869:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584704:0@lo:104: 00010000:00010000:1.0:1788482907.666912:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788482907.666917:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6487:x1875360098583936:12345-0@lo:104: Request processed in 91us (4320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.666924:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788482907.666947:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788482907.666958:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584576 00000100:00100000:1.0:1788482907.666961:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584576 00000100:00100000:1.0:1788482907.666983:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788482907.666986:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.666993:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6487:x1875360098584064:12345-0@lo:104: 00010000:00010000:1.0:1788482907.667001:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.667003:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61540 going to sleep for 11 seconds 00000100:00100000:2.0:1788482907.667024:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f51500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098583680:0@lo:104: 00000100:00100000:2.0:1788482907.667038:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098583808:0@lo:104: 00000100:00100000:2.0:1788482907.667046:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098583936:0@lo:104: 00000100:00100000:0.0:1788482907.667135:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788482907.667143:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788482907.669385:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098584320:0@lo:103: 00000100:00100000:2.0:1788482907.669456:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.670359:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584320 00000100:00100000:3.0:1788482907.670369:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584320 00010000:00010000:3.0:1788482907.670404:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 22 pid: 6486 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.670450:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482907.670457:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:3620:x1875360098584320:12345-0@lo:103: 00010000:00010000:3.0:1788482907.670470:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482907.670475:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 22 pid: 6486 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.670487:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 22 pid: 6486 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.670504:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a3d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3d2 expref: 22 pid: 6486 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.670519:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482907.670566:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3620:x1875360098584320:12345-0@lo:103: Request processed in 109us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.670572:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482907.670617:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098584320:0@lo:103: 00000100:00100000:3.0:1788482907.671028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.671056:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584192 00000100:00100000:3.0:1788482907.671060:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584192 00010000:00010000:3.0:1788482907.671076:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 21 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.671116:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788482907.671123:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3619:x1875360098584192:12345-0@lo:103: 00010000:00010000:3.0:1788482907.671131:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482907.671135:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 21 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.671172:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 21 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.671772:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788482907.671781:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6487:x1875360098584064:12345-0@lo:104: Request processed in 4790us (5694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.671790:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788482907.671817:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584704 00000100:00100000:1.0:1788482907.671822:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584704 00000100:00100000:1.0:1788482907.671841:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788482907.671931:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1a3af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a3a8 expref: 21 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.671946:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482907.671983:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3619:x1875360098584192:12345-0@lo:103: Request processed in 861us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.671990:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788482907.672033:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098584192:0@lo:103: 00000100:00100000:1.0:1788482907.672324:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6487:x1875360098584448:12345-0@lo:104: 00010000:00010000:1.0:1788482907.672336:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672384:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788482907.672389:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:6487:x1875360098584448:12345-0@lo:104: Request processed in 543us (5924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.672395:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788482907.672410:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788482907.672416:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6487:x1875360098584576:12345-0@lo:104: 00010000:00010000:1.0:1788482907.672423:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672449:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788482907.672454:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:6487:x1875360098584576:12345-0@lo:104: Request processed in 39us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.672459:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788482907.672485:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788482907.672492:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6487:x1875360098584704:12345-0@lo:104: 00010000:00010000:1.0:1788482907.672499:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672525:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788482907.672530:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6487:x1875360098584704:12345-0@lo:104: Request processed in 39us (5549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.672546:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788482907.672564:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788482907.672570:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672582:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788482907.672587:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672595:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482907.672602:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482907.672607:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482907.672767:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672773:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482907.672794:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672800:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0030400/0x1d7ea3d89ea1a385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a393 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672812:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788482907.672815:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672829:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788482907.672832:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.672838:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482907.672845:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482907.672858:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482907.672906:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788482907.672911:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.672918:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482907.672921:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.672927:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482907.672934:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482907.672940:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788482907.674088:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584064:0@lo:104: 00000100:00100000:2.0:1788482907.674128:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584448:0@lo:104: 00000100:00100000:2.0:1788482907.674140:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584576:0@lo:104: 00010000:00010000:1.0:1788482907.674147:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.674152:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875360098584704:0@lo:104: 00010000:00010000:1.0:1788482907.674162:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482907.674173:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674196:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a369 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674208:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788482907.674212:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674217:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788482907.674220:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674240:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482907.674246:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482907.674251:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482907.674266:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674271:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482907.674288:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674294:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a30e expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674303:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482907.674306:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674311:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788482907.674314:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674319:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482907.674325:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482907.674335:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482907.674350:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674355:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482907.674359:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674365:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a2dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a2e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.674374:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482907.674375:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482907.674376:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482907.674391:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098584832:0@lo:103: 00000100:00100000:1.0:1788482907.674444:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.674482:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482907.674489:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098584960:0@lo:103: 00000100:00100000:1.0:1788482907.674511:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482907.674537:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482907.674560:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098585088:0@lo:103: 00000100:00100000:1.0:1788482907.674582:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.674600:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482907.674605:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098585216:0@lo:103: 00000100:00100000:1.0:1788482907.674638:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482907.674691:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.676205:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584832 00000100:00100000:2.0:1788482907.676217:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584832 00010000:00010000:2.0:1788482907.676252:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 20 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.676276:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098584960 00000100:00100000:2.0:1788482907.676279:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098584960 00010000:00010000:2.0:1788482907.676291:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.676301:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585088 00000100:00100000:2.0:1788482907.676304:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585088 00010000:00010000:2.0:1788482907.676313:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 22 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.676340:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585216 00000100:00100000:2.0:1788482907.676342:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585216 00010000:00010000:2.0:1788482907.676352:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 23 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.676364:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788482907.676372:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:3621:x1875360098584832:12345-0@lo:103: 00010000:00010000:2.0:1788482907.676385:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482907.676391:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 23 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676403:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 23 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676422:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a385 expref: 23 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676436:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482907.676500:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:3621:x1875360098584832:12345-0@lo:103: Request processed in 128us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.676507:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788482907.676523:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788482907.676529:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3621:x1875360098584960:12345-0@lo:103: 00010000:00010000:2.0:1788482907.676536:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482907.676541:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676550:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676567:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a362 expref: 21 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676576:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482907.676600:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3621:x1875360098584960:12345-0@lo:103: Request processed in 72us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.676606:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788482907.676649:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788482907.676665:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:3619:x1875360098585088:12345-0@lo:103: 00010000:00010000:2.0:1788482907.676673:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482907.676677:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 19 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676685:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 19 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676695:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1a30e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a307 expref: 19 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676702:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482907.676747:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3619:x1875360098585088:12345-0@lo:103: Request processed in 83us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.676753:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788482907.676766:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788482907.676771:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:3619:x1875360098585216:12345-0@lo:103: 00010000:00010000:2.0:1788482907.676779:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482907.676783:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 17 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676797:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 17 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676806:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a2e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2dd expref: 17 pid: 6487 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.676816:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482907.676841:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3619:x1875360098585216:12345-0@lo:103: Request processed in 69us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.676847:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788482907.678139:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098585216:0@lo:103: 00000100:00100000:0.0:1788482907.678157:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098585088:0@lo:103: 00010000:00010000:3.0:1788482907.679813:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.679845:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482907.679944:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.679951:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0030800/0x1d7ea3d89ea1a346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a34d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.679964:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788482907.679973:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482907.679977:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482907.679980:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482907.679989:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098585344:0@lo:103: 00000100:00100000:2.0:1788482907.680060:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482907.680221:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098584960:0@lo:103: 00000100:00100000:0.0:1788482907.680231:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098584832:0@lo:103: 00000100:00100000:3.0:1788482907.681154:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585344 00000100:00100000:3.0:1788482907.681163:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585344 00010000:00010000:3.0:1788482907.681212:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 16 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.681247:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482907.681255:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3622:x1875360098585344:12345-0@lo:103: 00010000:00010000:3.0:1788482907.681269:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482907.681274:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 16 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681286:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 16 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681303:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a34d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a346 expref: 16 pid: 6488 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681319:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681340:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681356:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681362:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681368:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681374:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681380:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788482907.681384:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681391:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681412:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.681422:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788482907.681476:0:6487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.681487:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.681491:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3622:x1875360098585344:12345-0@lo:103: Request processed in 235us (1429us total) trans 0 rc 0/0 00010000:00010000:2.0:1788482907.681500:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1a3ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.681505:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 20000000:01000000:2.0:1788482907.681523:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788482907.681623:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098585344:0@lo:103: 00000100:00100000:2.0:1788482907.684247:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:9488:x1875360098583552:12345-0@lo:253: Request processed in 33162us (33360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.684265:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788482907.684671:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098583552:0@lo:253: 10000000:01000000:0.0:1788482907.684686:0:9488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788482907.684689:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788482907.684691:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788482907.684692:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788482907.684693:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788482907.684695:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788482907.684696:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788482907.684697:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788482907.684699:0:9488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788482907.684700:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788482907.684702:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788482907.684723:0:9488:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a68c1c41000 from lustre-OST0001 10000000:01000000:0.0:1788482907.684760:0:9488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788482907.684763:0:9488:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788482907.684772:0:9488:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69f45ecd28 local copy 10000000:01000000:0.0:1788482907.684776:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788482907.684810:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.684821:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.684830:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482907.684857:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd931c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585472:0@lo:101: 00000100:00100000:0.0:1788482907.684895:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482907.684938:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716540 going to sleep for 11 seconds 00000100:00100000:2.0:1788482907.684973:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585472 00000100:00100000:2.0:1788482907.684980:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585472 00000100:00100000:2.0:1788482907.685033:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788482907.685050:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+14:9488:x1875360098585472:12345-0@lo:101: 00010000:00010000:2.0:1788482907.685062:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482907.685076:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1400/0x1d7ea3d89ea1a3fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a3f5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.685128:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1400/0x1d7ea3d89ea1a3fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3f5 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.685140:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1400/0x1d7ea3d89ea1a3fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3f5 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.685149:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1400, rc 0) 00000100:00100000:2.0:1788482907.685191:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098585472:12345-0@lo:101: Request processed in 143us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.685197:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788482907.685311:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd931c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585472:0@lo:101: 00010000:00010000:3.0:1788482907.685333:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.685343:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.685448:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585600:0@lo:501: 00000100:00100000:3.0:1788482907.685477:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.685508:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2799780 going to sleep for 11 seconds 00000100:00100000:2.0:1788482907.685553:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585600 00000100:00100000:2.0:1788482907.685557:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585600 00000100:00100000:2.0:1788482907.685589:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788482907.685596:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098585600:12345-0@lo:501: 00000100:00100000:2.0:1788482907.685763:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098585600:12345-0@lo:501: Request processed in 166us (283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788482907.685770:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788482907.685827:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585600:0@lo:501: 10000000:01000000:3.0:1788482907.685839:0:9488:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788482907.685930:0:9488:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788482907.685936:0:9488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.685944:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.685950:0:9488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.685975:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788482907.685999:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a68c1c41000 10000000:01000000:3.0:1788482907.686004:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788482907.686010:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788482907.686012:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788482907.686018:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 00010000:00010000:0.0:1788482907.686018:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1788482907.686022:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788482907.686028:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.686040:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030000 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482907.686045:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.686053:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.686062:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.686064:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.686082:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482907.686082:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482907.686119:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788482907.686134:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585728:0@lo:101: 00010000:00010000:0.0:1788482907.686153:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.686160:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788482907.686169:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482907.686185:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.686192:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a3f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d7ea3d89ea1a3fc expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.686208:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d06c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788482907.686209:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482907.686212:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482907.686216:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482907.686226:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482907.686229:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585728 00000100:00100000:3.0:1788482907.686234:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585728 00000100:00100000:0.0:1788482907.686239:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098585856:0@lo:103: 00000100:00100000:3.0:1788482907.686263:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788482907.686271:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098585728:12345-0@lo:101: 00000100:00100000:0.0:1788482907.686276:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788482907.686282:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482907.686295:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a403 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.686310:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.686318:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.686325:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528000, rc 0) 00000100:00100000:3.0:1788482907.686360:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098585728:12345-0@lo:101: Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.686366:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788482907.686568:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585728:0@lo:101: 00010000:00010000:0.0:1788482907.686581:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.686590:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482907.687042:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585984:0@lo:501: 00000100:00100000:0.0:1788482907.687079:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482907.687134:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d27163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.687990:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585984 00000100:00100000:3.0:1788482907.688000:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585984 00000100:00100000:3.0:1788482907.688050:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788482907.688058:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098585984:12345-0@lo:501: 00000100:00100000:3.0:1788482907.688208:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098585984:12345-0@lo:501: Request processed in 150us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.688216:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788482907.688256:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098585984:0@lo:501: 00000100:00100000:3.0:1788482907.688293:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586112:0@lo:503: 00000100:00100000:3.0:1788482907.688337:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.688354:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d78240 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.688371:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098586112 00000100:00100000:3.0:1788482907.688374:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098586112 00000100:00100000:3.0:1788482907.688393:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788482907.688399:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586112:12345-0@lo:503: 00000100:00100000:3.0:1788482907.688473:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586112:12345-0@lo:503: Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.688479:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788482907.688518:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586112:0@lo:503: 00000100:00100000:2.0:1788482907.689889:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098585856 00000100:00100000:2.0:1788482907.689900:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098585856 00000100:00100000:2.0:1788482907.689952:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482907.689961:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3621:x1875360098585856:12345-0@lo:103: 00010000:00010000:2.0:1788482907.689975:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482907.689997:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1400/0x1d7ea3d89ea1a3fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a3f5 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.690030:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482907.690118:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3621:x1875360098585856:12345-0@lo:103: Request processed in 158us (3843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.690126:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482907.690172:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098585856:0@lo:103: 00000040:00080000:3.0:1788482907.690181:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788482907.690272:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586240:0@lo:502: 00000100:00100000:3.0:1788482907.690315:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.690350:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d78240 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.690380:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098586240 00000100:00100000:3.0:1788482907.690384:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098586240 00000100:00100000:3.0:1788482907.690415:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788482907.690422:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098586240:12345-0@lo:502: 00000100:00100000:3.0:1788482907.690539:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098586240:12345-0@lo:502: Request processed in 117us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.690546:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788482907.691169:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586240:0@lo:502: 00000040:00080000:3.0:1788482907.691379:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788482907.691407:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788482907.691420:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788482907.691433:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788482907.691448:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788482907.691461:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788482907.691501:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586368:0@lo:502: 00000100:00100000:2.0:1788482907.693821:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.693886:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.694972:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098586368 00000100:00100000:3.0:1788482907.694985:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098586368 00000100:00100000:3.0:1788482907.695048:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788482907.695058:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098586368:12345-0@lo:502: 00000100:00100000:3.0:1788482907.695310:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098586368:12345-0@lo:502: Request processed in 252us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.695318:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788482907.695805:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586368:0@lo:502: 00000040:00080000:0.0:1788482907.696011:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788482907.696027:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788482907.699370:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788482907.699381:0:9500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788482907.699388:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482907.699391:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788482907.699397:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788482907.699412:0:9500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a68c24e3370) 00000020:00000080:0.0:1788482907.699447:0:9500:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788482907.699455:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788482907.699525:0:9500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c1c41000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788482907.699534:0:9500:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788482907.699541:0:9500:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d7ea3d89ea1a418 00010000:00010000:0.0:1788482907.709256:0:9500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788482907.709725:0:9500:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788482907.714875:0:9500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788482907.715332:0:9500:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788482907.722394:0:9500:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788482907.722971:0:9500:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788482907.730756:0:9500:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788482907.732761:0:9500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788482907.732774:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482907.732780:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482907.732782:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788482907.732786:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482907.732789:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482907.732791:0:9500:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788482907.732793:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788482907.732795:0:9500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788482907.732817:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482907.732819:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482907.732820:0:9500:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788482907.732823:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788482907.733121:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788482907.733151:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788482907.733170:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.733182:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482907.733199:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c1c41000 from 1 10000000:01000000:2.0:1788482907.733203:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482907.733240:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.733248:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.733260:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.733285:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586496:0@lo:101: 00000100:00100000:2.0:1788482907.733353:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.733412:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.733634:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098586496 00000100:00100000:3.0:1788482907.733641:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098586496 00000100:00100000:3.0:1788482907.733703:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788482907.733716:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:9488:x1875360098586496:12345-0@lo:101: 00010000:00010000:3.0:1788482907.733729:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482907.733743:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a41f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.733766:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.733785:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.733793:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528c00, rc 0) 00000100:00100000:3.0:1788482907.733834:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586496:12345-0@lo:101: Request processed in 123us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.733840:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788482907.734047:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586496:0@lo:101: 00010000:00010000:2.0:1788482907.734064:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.734073:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.734338:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586624:0@lo:501: 00000100:00100000:2.0:1788482907.734367:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.734394:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.734459:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098586624 00000100:00100000:3.0:1788482907.734465:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098586624 00000100:00100000:3.0:1788482907.734500:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788482907.734507:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586624:12345-0@lo:501: 00000100:00100000:3.0:1788482907.734618:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586624:12345-0@lo:501: Request processed in 111us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.734761:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586624:0@lo:501: 00000100:00100000:2.0:1788482907.734790:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586752:0@lo:503: 00000100:00100000:2.0:1788482907.734831:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.734855:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098586752 00000100:00100000:2.0:1788482907.734858:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098586752 00000100:00100000:2.0:1788482907.734876:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788482907.734954:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788482907.735278:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586752:12345-0@lo:503: 00000100:00100000:2.0:1788482907.735364:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586752:12345-0@lo:503: Request processed in 481us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.735371:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788482907.735412:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482907.735426:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586752:0@lo:503: 00000040:00080000:2.0:1788482907.736075:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788482907.736262:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586880:0@lo:502: 00000100:00100000:2.0:1788482907.736308:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.736334:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482907.736351:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098586880 00000100:00100000:2.0:1788482907.736355:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098586880 00000100:00100000:2.0:1788482907.736424:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788482907.736432:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586880:12345-0@lo:502: 00000100:00100000:2.0:1788482907.736515:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098586880:12345-0@lo:502: Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.736522:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788482907.738208:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098586880:0@lo:502: 00000040:00080000:0.0:1788482907.738473:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788482907.738508:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788482907.738546:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587008:0@lo:502: 00000100:00100000:0.0:1788482907.738812:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482907.738857:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716900 going to sleep for 11 seconds 00000100:00100000:1.0:1788482907.738992:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587008 00000100:00100000:1.0:1788482907.738999:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587008 00000100:00100000:1.0:1788482907.739033:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788482907.739041:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098587008:12345-0@lo:502: 00000100:00100000:1.0:1788482907.739169:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098587008:12345-0@lo:502: Request processed in 129us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.739177:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788482907.739444:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587008:0@lo:502: 00000040:00080000:0.0:1788482907.739492:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788482907.739502:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788482907.743127:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482907.743141:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482907.743143:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788482907.743151:0:9504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c1c41000 00000020:00000080:1.0:1788482907.743153:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788482907.743165:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482907.743168:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482907.743169:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788482907.743172:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788482907.743363:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788482907.743396:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788482907.743418:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.743430:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482907.743483:0:9488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788482907.743486:0:9488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a68c1c41000 10000000:01000000:2.0:1788482907.743489:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a68c1c41000 10000000:01000000:2.0:1788482907.743493:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788482907.743498:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68c1c41000 from 1 10000000:01000000:2.0:1788482907.743501:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788482907.743536:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.743544:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.743775:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482907.743814:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587136:0@lo:101: 00000100:00100000:2.0:1788482907.743955:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.744037:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.745024:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587136 00000100:00100000:3.0:1788482907.745036:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587136 00000100:00100000:3.0:1788482907.745111:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788482907.745122:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9488:x1875360098587136:12345-0@lo:101: 00010000:00010000:3.0:1788482907.745140:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482907.745157:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a42d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.745184:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.745194:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.745213:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529c00, rc 0) 00000100:00100000:3.0:1788482907.745281:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587136:12345-0@lo:101: Request processed in 161us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.745288:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788482907.745345:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587136:0@lo:101: 00010000:00010000:3.0:1788482907.745361:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.745371:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.745463:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587264:0@lo:501: 00000100:00100000:3.0:1788482907.745496:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.745514:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d78240 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.745529:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587264 00000100:00100000:3.0:1788482907.745533:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587264 00000100:00100000:3.0:1788482907.745565:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788482907.745571:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587264:12345-0@lo:501: 00000100:00100000:3.0:1788482907.746449:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587264:12345-0@lo:501: Request processed in 874us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.746457:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788482907.746728:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587264:0@lo:501: 00000100:00100000:2.0:1788482907.746771:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587392:0@lo:503: 00000100:00100000:2.0:1788482907.746813:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.746837:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.747018:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587392 00000100:00100000:3.0:1788482907.747024:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587392 00000100:00100000:3.0:1788482907.747062:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788482907.747069:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587392:12345-0@lo:503: 00000100:00100000:3.0:1788482907.747198:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587392:12345-0@lo:503: Request processed in 128us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.747211:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788482907.747312:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587392:0@lo:503: 00000040:00080000:0.0:1788482907.747573:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788482907.747871:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587520:0@lo:502: 00000100:00100000:0.0:1788482907.748054:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482907.748092:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716900 going to sleep for 11 seconds 00000100:00100000:3.0:1788482907.748191:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587520 00000100:00100000:3.0:1788482907.748196:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587520 00000100:00100000:3.0:1788482907.748223:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788482907.748231:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587520:12345-0@lo:502: 00000100:00100000:3.0:1788482907.748331:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587520:12345-0@lo:502: Request processed in 100us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.748338:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788482907.748492:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587520:0@lo:502: 00000040:00080000:0.0:1788482907.749744:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788482907.749798:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788482907.749814:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788482907.749829:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788482907.749842:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788482907.749871:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788482907.750018:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788482907.750035:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788482907.750049:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788482907.750061:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788482907.750073:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788482907.750085:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788482907.750120:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788482907.750136:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788482907.750148:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788482907.750159:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788482907.750171:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788482907.750185:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788482907.750199:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788482907.750212:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788482907.750224:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788482907.750250:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788482907.750266:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788482907.750281:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788482907.750294:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788482907.750308:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788482907.750321:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788482907.750336:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788482907.750349:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788482907.750363:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788482907.750388:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788482907.750400:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788482907.750413:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788482907.750426:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788482907.750439:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788482907.750472:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788482907.750490:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788482907.750520:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788482907.750537:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788482907.750550:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788482907.750577:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788482907.750592:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788482907.750616:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788482907.750795:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788482907.750814:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788482907.750827:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788482907.750873:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587648:0@lo:502: 00000100:00100000:0.0:1788482907.752149:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482907.752201:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716900 going to sleep for 11 seconds 00000100:00100000:2.0:1788482907.752764:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587648 00000100:00100000:2.0:1788482907.752773:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587648 00000100:00100000:2.0:1788482907.752820:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788482907.752829:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587648:12345-0@lo:502: 00000100:00100000:2.0:1788482907.752973:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098587648:12345-0@lo:502: Request processed in 144us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.752980:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788482907.753041:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098587648:0@lo:502: 00000040:00080000:2.0:1788482907.753138:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788482907.753150:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788482907.756061:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788482907.756079:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a68c24e0000) 00000020:00000080:0.0:1788482907.756141:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788482907.756267:0:9505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c1c41000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788482907.756271:0:9505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c1c41000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788482907.756274:0:9505:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c1c41000 3 00010000:00080000:0.0:1788482907.756302:0:9505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c33c2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788482907.763401:0:9505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788482907.763620:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788482907.763833:0:9505:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788482907.763846:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1d7ea3d89ea1a442 00000100:00080000:1.0:1788482907.763857:0:9505:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482907.763862:0:9505:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a68c33c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482907.763959:0:9505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd935880 x1875360098587776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788482907.764026:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098587776:0@lo:38: 00000100:00100000:0.0:1788482907.764115:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788482907.764191:0:9505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788482907.764289:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098587904:0@lo:400: 00000100:00100000:1.0:1788482907.764318:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.764336:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098588416:0@lo:400: 00000100:00100000:1.0:1788482907.764356:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.764376:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788482907.764381:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098588032:0@lo:400: 00000100:00100000:1.0:1788482907.764417:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.764436:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098588544:0@lo:400: 00000100:00100000:1.0:1788482907.764459:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.764487:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587776 00000100:00100000:1.0:1788482907.764493:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587776 00000100:00100000:1.0:1788482907.764513:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098587904 00000100:00100000:1.0:1788482907.764515:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098587904 00000100:00100000:1.0:1788482907.764534:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588416 00000100:00100000:1.0:1788482907.764537:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588416 00000100:00100000:1.0:1788482907.764554:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588544 00000100:00100000:1.0:1788482907.764557:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588544 00000100:00100000:1.0:1788482907.764572:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482907.764579:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098587904:12345-0@lo:400: 00000100:00100000:2.0:1788482907.764754:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482907.764761:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1875360098587776:12345-0@lo:38: 00010000:00080000:2.0:1788482907.764781:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1788482907.764818:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1d7ea3d89ea1a449 00000004:00100000:2.0:1788482907.764832:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788482907.764864:0:6495:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788482907.765299:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098588288:0@lo:400: 00000100:00100000:2.0:1788482907.765481:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875360098587776:12345-0@lo:38: Request processed in 718us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.765498:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482907.765518:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788482907.765525:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098588416:12345-0@lo:400: 00000100:00100000:2.0:1788482907.765566:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098588416:12345-0@lo:400: Request processed in 42us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.765573:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788482907.765585:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788482907.765604:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098588544:12345-0@lo:400: 00000100:00100000:2.0:1788482907.765765:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098588544:12345-0@lo:400: Request processed in 172us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.765771:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788482907.765797:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588032 00000100:00100000:2.0:1788482907.765802:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588032 00000100:00100000:2.0:1788482907.765830:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788482907.765835:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098588032:12345-0@lo:400: 00000100:00100000:2.0:1788482907.765865:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098588032:12345-0@lo:400: Request processed in 30us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.765870:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788482907.765897:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788482907.765901:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482907.765929:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098588032:0@lo:400: 00010000:00080000:2.0:1788482907.765948:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd934e00 x1875360098588544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482907.765958:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098588544:0@lo:400: 00010000:00080000:2.0:1788482907.765969:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd936300 x1875360098588416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482907.765984:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098588416:0@lo:400: 00010000:00080000:0.0:1788482907.766143:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd935880 x1875360098587776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482907.766163:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788482907.766171:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788482907.766179:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788482907.766183:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788482907.766186:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788482907.766192:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098587776:0@lo:38: 00000100:00100000:2.0:1788482907.766267:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098588160:0@lo:400: 00000100:00100000:2.0:1788482907.766301:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.766361:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098588672:0@lo:400: 00000100:00100000:2.0:1788482907.766385:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.766418:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588672 00000100:00100000:2.0:1788482907.766422:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588672 00000100:00100000:2.0:1788482907.766458:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482907.766466:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098588672:12345-0@lo:400: 00000100:00100000:2.0:1788482907.766503:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098588672:12345-0@lo:400: Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.766509:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788482907.766525:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788482907.766543:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69d0f3a300 x1875360098588672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482907.766551:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098588672:0@lo:400: 00000100:00100000:1.0:1788482907.766816:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098587904:12345-0@lo:400: Request processed in 2234us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.766834:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482907.766849:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588160 00000100:00100000:1.0:1788482907.766852:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588160 00010000:00080000:2.0:1788482907.766972:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd934380 x1875360098587904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482907.766981:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098587904:0@lo:400: 00000100:00100000:0.0:1788482907.767024:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788482907.767033:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098588160:12345-0@lo:400: 00000100:00100000:0.0:1788482907.767082:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098588160:12345-0@lo:400: Request processed in 51us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482907.767088:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788482907.767174:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd937100 x1875360098588160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482907.767184:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098588160:0@lo:400: 00000100:00100000:3.0:1788482907.767256:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.767316:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098588800:0@lo:400: 00000100:00100000:3.0:1788482907.767342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.767372:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588800 00000100:00100000:3.0:1788482907.767376:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588800 00000100:00100000:3.0:1788482907.767413:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788482907.767419:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098588800:12345-0@lo:400: 00000100:00100000:3.0:1788482907.767452:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098588800:12345-0@lo:400: Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.767458:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788482907.767482:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69d0f3aa00 x1875360098588800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482907.767491:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098588800:0@lo:400: 00000100:00080000:2.0:1788482907.767751:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1788482907.769544:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788482907.769559:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a69edaa0000) 00000020:00000080:2.0:1788482907.769584:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788482907.769717:0:9505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c1c41000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788482907.769723:0:9505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c1c41000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788482907.769726:0:9505:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c1c41000 3 00010000:00080000:2.0:1788482907.769757:0:9505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c33a2000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788482907.771412:0:9505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:1.0:1788482907.772850:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9506:1875360098588928:0@lo:901: 00000100:00100000:1.0:1788482907.772948:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.772996:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588928 00000100:00100000:1.0:1788482907.773002:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588928 00000100:00100000:1.0:1788482907.773053:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788482907.773063:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9506:x1875360098588928:12345-0@lo:901: 00000100:00100000:1.0:1788482907.773174:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9506:x1875360098588928:12345-0@lo:901: Request processed in 112us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.773182:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788482907.773204:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482907.773218:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7600 going to sleep for 11 seconds 00010000:00080000:1.0:1788482907.773242:0:9506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c34fca80 x1875360098588928/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788482923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482907.773256:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9506:1875360098588928:0@lo:901: 00000100:00100000:0.0:1788482907.777024:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098588288 00000100:00100000:0.0:1788482907.777041:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098588288 00000100:00100000:0.0:1788482907.777122:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788482907.777132:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098588288:12345-0@lo:400: 00000100:00100000:0.0:1788482907.777237:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098588288:12345-0@lo:400: Request processed in 106us (9981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482907.777244:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:00000080:2.0:1788482907.777475:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788482907.777553:0:9505:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788482907.777567:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1d7ea3d89ea1a457 00000100:00080000:2.0:1788482907.777575:0:9505:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788482907.777580:0:9505:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a68c33a2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788482907.777791:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098588288:0@lo:400: 00000100:00100000:2.0:1788482907.778764:0:9505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3074380 x1875360098589056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788482907.778784:0:9505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788482907.780774:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098589056:0@lo:38: 00000100:00100000:0.0:1788482907.780844:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482907.784452:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589056 00000100:00100000:1.0:1788482907.784468:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589056 00000100:00100000:1.0:1788482907.784510:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788482907.784518:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1875360098589056:12345-0@lo:38: 00010000:00080000:1.0:1788482907.784545:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1788482907.784581:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1d7ea3d89ea1a45e 00000004:00100000:1.0:1788482907.784606:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788482907.784646:0:6495:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482907.785167:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875360098589056:12345-0@lo:38: Request processed in 647us (4321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482907.785188:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788482907.788128:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3074380 x1875360098589056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482907.788154:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482907.788166:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788482907.788175:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788482907.788180:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788482907.788183:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482907.788191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098589056:0@lo:38: 00000040:00080000:2.0:1788482907.790205:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788482907.791843:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788482907.791953:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788482907.791976:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482907.791989:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788482907.792045:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788482907.792047:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788482907.792049:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482907.792050:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482907.792052:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482907.792058:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482907.792060:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788482907.792062:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482907.792063:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482907.792065:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482907.792066:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788482907.792069:0:9488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788482907.792072:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788482907.792073:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788482907.792074:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482907.792075:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482907.792076:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482907.792077:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482907.792078:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788482907.792079:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482907.792080:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482907.792081:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482907.792082:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788482907.792181:0:9488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788482907.792430:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098589184:0@lo:253: 00000100:00100000:2.0:1788482907.792537:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.792756:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd61240 going to sleep for 11 seconds 00000100:00100000:0.0:1788482907.793909:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589184 00000100:00100000:0.0:1788482907.793919:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589184 00000100:00100000:0.0:1788482907.793974:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788482907.793984:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098589184:12345-0@lo:253: 20000000:01000000:0.0:1788482907.794015:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788482907.794040:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788482907.801462:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788482907.801484:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788482907.801604:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788482907.801609:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788482907.801635:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.801663:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.801671:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.801679:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.801719:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.801734:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 17 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.801748:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098589312:0@lo:104: 00000100:00100000:3.0:1788482907.801809:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788482907.801878:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.801887:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 17 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.801896:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098589440:0@lo:104: 00000100:00100000:3.0:1788482907.801918:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.802030:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2a84600 going to sleep for 11 seconds 00000100:00100000:2.0:1788482907.803547:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589312 00000100:00100000:0.0:1788482907.807887:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589440 00000100:00100000:0.0:1788482907.807903:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589440 00000100:00100000:0.0:1788482907.807972:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788482907.807982:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098589440:12345-0@lo:104: 00010000:00010000:0.0:1788482907.808000:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.808093:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482907.808116:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098589440:12345-0@lo:104: Request processed in 136us (6197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482907.808123:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788482907.808464:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098589440:0@lo:104: 00000100:00100000:0.0:1788482907.808500:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9488:x1875360098589184:12345-0@lo:253: Request processed in 14221us (15666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482907.808511:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788482907.808981:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589312 00000100:00100000:2.0:1788482907.809011:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9488:1875360098589184:0@lo:253: 10000000:01000000:2.0:1788482907.809024:0:9488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788482907.809027:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788482907.809028:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788482907.809030:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482907.809031:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482907.809032:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482907.809033:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482907.809035:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788482907.809036:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482907.809037:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482907.809039:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482907.809040:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788482907.809055:0:9488:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788482907.810619:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482907.810633:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.810644:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482907.810648:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.810669:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482907.810676:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482907.810700:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482907.810747:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.810753:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482907.810772:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.810779:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a354 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a35b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482907.810794:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482907.810796:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482907.810797:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482907.810963:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482907.810974:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098589312:12345-0@lo:104: 00010000:00010000:3.0:1788482907.810983:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.811074:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875360098589312:0@lo:104: 00010000:00010000:3.0:1788482907.811121:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.811143:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788482907.811148:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:6509:x1875360098589312:12345-0@lo:104: Request processed in 178us (9340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.811155:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788482907.811185:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482907.811190:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.811197:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482907.811200:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.811222:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482907.811227:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482907.811232:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482907.811246:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.811251:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482907.811257:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.811263:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0031200/0x1d7ea3d89ea1a39a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a3a1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.811277:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482907.811278:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482907.811280:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482907.818192:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098589696:0@lo:103: 00000100:00100000:0.0:1788482907.818270:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482907.818350:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788482907.818357:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098589568:0@lo:103: 00000100:00100000:0.0:1788482907.818378:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.818597:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589696 00000100:00100000:3.0:1788482907.818605:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589696 00010000:00010000:3.0:1788482907.818638:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 17 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.818675:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589568 00000100:00100000:3.0:1788482907.818678:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589568 00010000:00010000:3.0:1788482907.818690:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 18 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482907.818711:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788482907.818737:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3620:x1875360098589696:12345-0@lo:103: 00010000:00010000:3.0:1788482907.818752:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482907.818758:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 18 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818768:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 18 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818787:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a3a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a39a expref: 18 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818802:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482907.818839:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:3620:x1875360098589696:12345-0@lo:103: Request processed in 104us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.818845:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788482907.818861:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482907.818868:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3620:x1875360098589568:12345-0@lo:103: 00010000:00010000:3.0:1788482907.818890:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482907.818896:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 16 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818905:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 16 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818915:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0031800/0x1d7ea3d89ea1a35b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a354 expref: 16 pid: 6486 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818938:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818957:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788482907.818971:0:6479:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017363028s 00010000:00010000:3.0:1788482907.818976:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818983:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818991:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.818997:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.819004:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788482907.819008:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.819015:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.819042:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482907.819053:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482907.819077:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3620:x1875360098589568:12345-0@lo:103: Request processed in 210us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.819083:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482907.819151:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098589568:0@lo:103: 00000100:00100000:3.0:1788482907.819161:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098589696:0@lo:103: 00010000:00010000:1.0:1788482907.819737:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.819747:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482907.819753:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1528e00/0x1d7ea3d89ea1a465 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788482907.823343:0:9488:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788482907.823566:0:9488:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788482907.824092:0:9488:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788482907.824514:0:9488:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788482907.825276:0:9488:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788482907.825465:0:9488:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788482907.834992:0:9488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788482907.852908:0:9488:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788482907.852919:0:9488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788482907.852955:0:9488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788482907.852998:0:9488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788482907.853059:0:9488:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788482907.853091:0:9488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788482907.853994:0:9488:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482907.854327:0:9488:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788482907.898812:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098589952:0@lo:13: 00000100:00100000:3.0:1788482907.898883:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.898956:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482907.898964:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098589824:0@lo:13: 00000100:00100000:3.0:1788482907.898992:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482907.899040:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589952 00000100:00100000:3.0:1788482907.899048:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589952 00000100:00100000:3.0:1788482907.899091:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098589824 00000100:00100000:3.0:1788482907.899122:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098589824 00000100:00100000:3.0:1788482907.899148:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788482907.899158:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098589952:12345-0@lo:13: 00002000:00000024:3.0:1788482907.899541:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482907.900163:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098589952:12345-0@lo:13: Request processed in 1004us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.900187:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788482907.900213:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788482907.900222:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098589824:12345-0@lo:13: 00002000:00000024:3.0:1788482907.900236:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482907.900264:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098589824:12345-0@lo:13: Request processed in 44us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.900271:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788482907.900385:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd932680 x1875360098589824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482907.900405:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098589824:0@lo:13: 00010000:00080000:3.0:1788482907.900426:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd931500 x1875360098589952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482907.900437:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098589952:0@lo:13: 00000100:00100000:3.0:1788482907.902063:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482907.902086:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098590080:0@lo:41: 00000100:00100000:3.0:1788482907.902242:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482907.905874:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590080 00000100:00100000:2.0:1788482907.905888:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590080 00000100:00100000:2.0:1788482907.905942:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788482907.905951:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098590080:12345-0@lo:41: 00000004:00000024:2.0:1788482907.905988:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788482907.906068:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098590080:12345-0@lo:41: Request processed in 118us (3826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482907.906075:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788482907.909960:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098590080:0@lo:41: 00010000:00010000:2.0:1788482908.280805:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788482909.016911:0:9562:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788482909.017193:0:9562:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788482909.308124:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482910.328267:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482910.458785:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098590208:0@lo:41: 00000100:00100000:3.0:1788482910.458854:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482910.459181:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590208 00000100:00100000:1.0:1788482910.459190:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590208 00000100:00100000:1.0:1788482910.459236:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788482910.459246:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098590208:12345-0@lo:41: 00000004:00000024:1.0:1788482910.459276:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788482910.463824:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098590208:12345-0@lo:41: Request processed in 4567us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482910.463839:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788482910.466716:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098590208:0@lo:41: 00010000:00010000:2.0:1788482911.354423:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482912.376293:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482913.016470:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098590336:0@lo:400: 00000100:00100000:0.0:1788482913.016536:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016577:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098590848:0@lo:400: 00000100:00100000:0.0:1788482913.016601:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016620:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098591360:0@lo:400: 00000100:00100000:0.0:1788482913.016653:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016680:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788482913.016694:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098590464:0@lo:400: 00000100:00100000:0.0:1788482913.016781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016799:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098590976:0@lo:400: 00000100:00100000:0.0:1788482913.016821:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016837:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098591488:0@lo:400: 00000100:00100000:0.0:1788482913.016870:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016898:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098590592:0@lo:400: 00000100:00100000:0.0:1788482913.016921:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016938:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098591104:0@lo:400: 00000100:00100000:0.0:1788482913.016957:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016971:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098591616:0@lo:400: 00000100:00100000:0.0:1788482913.016988:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.016999:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788482913.017003:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098590720:0@lo:400: 00000100:00100000:0.0:1788482913.017020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.017028:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098591232:0@lo:400: 00000100:00100000:0.0:1788482913.017044:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.017074:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590336 00000100:00100000:0.0:1788482913.017082:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590336 00000100:00100000:0.0:1788482913.017148:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788482913.017157:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3621:x1875360098590336:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017207:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3621:x1875360098590336:12345-0@lo:400: Request processed in 51us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017214:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788482913.017245:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590848 00000100:00100000:0.0:1788482913.017249:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590848 00000100:00100000:0.0:1788482913.017277:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590592 00000100:00100000:0.0:1788482913.017281:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590592 00000100:00100000:0.0:1788482913.017295:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788482913.017301:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098590848:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017337:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098590848:12345-0@lo:400: Request processed in 37us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017343:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788482913.017355:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788482913.017360:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098590592:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017391:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098590592:12345-0@lo:400: Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017397:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788482913.017416:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098591360 00000100:00100000:0.0:1788482913.017419:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098591360 00000100:00100000:0.0:1788482913.017450:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098591232 00000100:00100000:0.0:1788482913.017454:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098591232 00000100:00100000:0.0:1788482913.017473:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482913.017479:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098591360:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017510:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098591360:12345-0@lo:400: Request processed in 31us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017516:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482913.017525:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788482913.017530:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098591232:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017553:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098591232:12345-0@lo:400: Request processed in 23us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017557:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788482913.017573:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590464 00000100:00100000:0.0:1788482913.017577:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590464 00000100:00100000:0.0:1788482913.017600:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590976 00000100:00100000:0.0:1788482913.017603:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590976 00000100:00100000:0.0:1788482913.017614:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098591488 00000100:00100000:0.0:1788482913.017616:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098591488 00000100:00100000:0.0:1788482913.017641:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098591104 00000100:00100000:0.0:1788482913.017644:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098591104 00000100:00100000:0.0:1788482913.017655:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098591616 00000100:00100000:0.0:1788482913.017657:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098591616 00000100:00100000:0.0:1788482913.017667:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098590720 00000100:00100000:0.0:1788482913.017669:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098590720 00000100:00100000:0.0:1788482913.017681:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788482913.017687:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098590464:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017717:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098590464:12345-0@lo:400: Request processed in 30us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017722:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788482913.017734:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788482913.017739:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098590976:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017765:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098590976:12345-0@lo:400: Request processed in 26us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017771:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788482913.017782:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482913.017788:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098591488:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017813:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098591488:12345-0@lo:400: Request processed in 25us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017818:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482913.017829:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482913.017834:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098591104:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017858:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098591104:12345-0@lo:400: Request processed in 24us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017870:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482913.017881:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482913.017887:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098591616:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017915:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098591616:12345-0@lo:400: Request processed in 28us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017920:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482913.017931:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788482913.017936:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098590720:12345-0@lo:400: 00000100:00100000:0.0:1788482913.017973:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098590720:12345-0@lo:400: Request processed in 37us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.017979:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788482913.018026:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd931c00 x1875360098590720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018040:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098590720:0@lo:400: 00010000:00080000:0.0:1788482913.018049:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca6680 x1875360098591232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018057:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098591232:0@lo:400: 00000100:00100000:0.0:1788482913.018066:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098590592:0@lo:400: 00010000:00080000:0.0:1788482913.018074:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca5f80 x1875360098591104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018080:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098591104:0@lo:400: 00010000:00080000:0.0:1788482913.018089:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ecc26680 x1875360098591616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018128:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098591616:0@lo:400: 00010000:00080000:0.0:1788482913.018165:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd930380 x1875360098590464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018173:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098590464:0@lo:400: 00010000:00080000:0.0:1788482913.018182:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd932680 x1875360098590976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018190:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098590976:0@lo:400: 00010000:00080000:0.0:1788482913.018198:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca4700 x1875360098591488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018206:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098591488:0@lo:400: 00000100:00100000:0.0:1788482913.018214:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098590336:0@lo:400: 00000100:00100000:0.0:1788482913.018222:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098590848:0@lo:400: 00010000:00080000:0.0:1788482913.018231:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca5880 x1875360098591360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.018239:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098591360:0@lo:400: 00000100:00080000:1.0:1788482913.018355:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788482913.018360:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482913.018362:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482913.019289:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482913.019304:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098591744:0@lo:13: 00000100:00100000:0.0:1788482913.019384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.019420:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098591744 00000100:00100000:0.0:1788482913.019425:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098591744 00000100:00100000:0.0:1788482913.019459:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788482913.019466:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098591744:12345-0@lo:13: 00002000:00000024:0.0:1788482913.019495:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482913.019531:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098591744:12345-0@lo:13: Request processed in 65us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.019537:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788482913.019567:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376e300 x1875360098591744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482913.019582:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098591744:0@lo:13: 00000100:00100000:1.0:1788482913.019687:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482913.019696:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098591872:0@lo:13: 00000100:00100000:1.0:1788482913.019724:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482913.019746:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098591872 00000100:00100000:1.0:1788482913.019749:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098591872 00000100:00100000:1.0:1788482913.019771:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788482913.019777:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098591872:12345-0@lo:13: 00002000:00000024:1.0:1788482913.019792:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482913.019822:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098591872:12345-0@lo:13: Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482913.019827:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788482913.019854:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fca80 x1875360098591872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482913.019865:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098591872:0@lo:13: 00000100:00100000:1.0:1788482913.022725:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098592000:0@lo:41: 00000100:00100000:1.0:1788482913.022790:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482913.022950:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592000 00000100:00100000:0.0:1788482913.022957:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592000 00000100:00100000:0.0:1788482913.023005:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788482913.023015:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098592000:12345-0@lo:41: 00000004:00000024:0.0:1788482913.023045:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788482913.031137:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098592000:12345-0@lo:41: Request processed in 8113us (8338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482913.031150:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788482913.034443:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098592000:0@lo:41: 00010000:00010000:3.0:1788482913.406899:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788482914.121918:0:9852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788482914.430726:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788482915.246424:0:9904:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482915.248883:0:9904:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788482915.449338:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482915.580402:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482915.580475:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098592128:0@lo:41: 00000100:00100000:2.0:1788482915.580543:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482915.580571:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592128 00000100:00100000:1.0:1788482915.580580:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592128 00000100:00100000:1.0:1788482915.580661:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788482915.580671:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098592128:12345-0@lo:41: 00000004:00000024:1.0:1788482915.580704:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788482915.580749:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098592128:12345-0@lo:41: Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482915.580756:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788482915.583799:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098592128:0@lo:41: 00010000:00010000:3.0:1788482916.474012:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788482916.600210:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788482916.600288:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69e00f6800 from 39 10000000:01000000:1.0:1788482916.600294:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482916.600341:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.600353:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.600383:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.600406:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592256:0@lo:101: 00000100:00100000:1.0:1788482916.600480:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.600864:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.601045:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592256 00000100:00100000:0.0:1788482916.601053:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592256 00000100:00100000:0.0:1788482916.601218:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788482916.601229:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098592256:12345-0@lo:101: 00010000:00010000:0.0:1788482916.601301:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482916.601316:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a46c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.601342:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.601352:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.601371:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030e00, rc 0) 00000100:00100000:0.0:1788482916.601417:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098592256:12345-0@lo:101: Request processed in 191us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.601425:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788482916.601510:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592256:0@lo:101: 00010000:00010000:1.0:1788482916.601526:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.601535:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.601596:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592384:0@lo:501: 00000100:00100000:1.0:1788482916.601650:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482916.602194:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592384 00000100:00100000:2.0:1788482916.602202:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592384 00000100:00100000:2.0:1788482916.602230:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788482916.602238:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098592384:12345-0@lo:501: 00000100:00100000:2.0:1788482916.602567:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098592384:12345-0@lo:501: Request processed in 329us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.602574:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788482916.605382:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.605429:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592384:0@lo:501: 00000100:00100000:1.0:1788482916.605491:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592512:0@lo:503: 00000100:00100000:1.0:1788482916.605570:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.605673:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.605739:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592512 00000100:00100000:2.0:1788482916.605746:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592512 00000100:00100000:2.0:1788482916.606772:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788482916.606787:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098592512:12345-0@lo:503: 00000100:00100000:2.0:1788482916.606965:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098592512:12345-0@lo:503: Request processed in 182us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.606972:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788482916.607062:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592512:0@lo:503: 00000100:00100000:1.0:1788482916.607614:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9956:1875360098592640:0@lo:502: 00000100:00100000:1.0:1788482916.607662:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.612679:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.612679:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592640 00000100:00100000:0.0:1788482916.612762:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592640 00000100:00100000:0.0:1788482916.612814:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788482916.612834:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9956:x1875360098592640:12345-0@lo:502: 00000100:00100000:0.0:1788482916.613158:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9956:x1875360098592640:12345-0@lo:502: Request processed in 335us (5495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.613167:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788482916.613769:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9956:1875360098592640:0@lo:502: 00000100:00100000:1.0:1788482916.614045:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9956:1875360098592768:0@lo:502: 00000100:00100000:1.0:1788482916.614121:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.614198:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.614240:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592768 00000100:00100000:0.0:1788482916.614245:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592768 00000100:00100000:0.0:1788482916.614583:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788482916.614595:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9956:x1875360098592768:12345-0@lo:502: 00000100:00100000:0.0:1788482916.615015:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:9956:x1875360098592768:12345-0@lo:502: Request processed in 422us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.615023:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788482916.615123:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9956:1875360098592768:0@lo:502: 00000040:00080000:1.0:1788482916.615149:0:9956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788482916.615488:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788482916.615987:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788482916.616000:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.616012:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482916.616022:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788482916.616025:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788482916.616028:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788482916.616057:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.616064:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.616085:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482916.616220:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592896:0@lo:101: 00000100:00100000:3.0:1788482916.616343:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.616384:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.616559:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098592896 00000100:00100000:2.0:1788482916.616567:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098592896 00000100:00100000:2.0:1788482916.616800:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788482916.616811:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098592896:12345-0@lo:101: 00010000:00010000:2.0:1788482916.616827:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482916.616840:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a47a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482916.616879:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482916.616889:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482916.616898:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0c00, rc 0) 00000100:00100000:2.0:1788482916.616957:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098592896:12345-0@lo:101: Request processed in 149us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.616963:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788482916.617034:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098592896:0@lo:101: 00010000:00010000:3.0:1788482916.617047:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.617056:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482916.617149:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593024:0@lo:501: 00000100:00100000:3.0:1788482916.617175:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.617437:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.617534:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593024 00000100:00100000:0.0:1788482916.617539:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593024 00000100:00100000:0.0:1788482916.617566:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788482916.617573:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098593024:12345-0@lo:501: 00000100:00100000:0.0:1788482916.620776:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098593024:12345-0@lo:501: Request processed in 3194us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.620791:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788482916.621207:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593024:0@lo:501: 00000100:00100000:3.0:1788482916.621342:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593152:0@lo:503: 00000100:00100000:3.0:1788482916.621405:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.621498:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.621539:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593152 00000100:00100000:2.0:1788482916.621547:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593152 00000100:00100000:2.0:1788482916.621751:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788482916.621761:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098593152:12345-0@lo:503: 00000100:00100000:2.0:1788482916.621918:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098593152:12345-0@lo:503: Request processed in 158us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.621926:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788482916.622021:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593152:0@lo:503: 00000100:00100000:0.0:1788482916.622487:0:9957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9957:1875360098593280:0@lo:502: 00000100:00100000:0.0:1788482916.622534:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.622733:0:9957:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdabd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.622775:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593280 00000100:00100000:2.0:1788482916.622780:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593280 00000100:00100000:2.0:1788482916.622849:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788482916.622857:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9957:x1875360098593280:12345-0@lo:502: 00000100:00100000:2.0:1788482916.622952:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9957:x1875360098593280:12345-0@lo:502: Request processed in 96us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.622959:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788482916.623030:0:9957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9957:1875360098593280:0@lo:502: 00000020:01000000:0.0:1788482916.623053:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482916.623064:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482916.623066:0:9957:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788482916.623071:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788482916.623074:0:9957:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788482916.623091:0:9957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9957:1875360098593408:0@lo:502: 00000100:00100000:0.0:1788482916.623154:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.623485:0:9957:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.623573:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593408 00000100:00100000:1.0:1788482916.623590:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593408 00000100:00100000:1.0:1788482916.623626:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788482916.623633:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9957:x1875360098593408:12345-0@lo:502: 00000100:00100000:1.0:1788482916.623718:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:9957:x1875360098593408:12345-0@lo:502: Request processed in 86us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.623725:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788482916.623794:0:9957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9957:1875360098593408:0@lo:502: 00000020:01000000:0.0:1788482916.623811:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482916.623815:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482916.623817:0:9957:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788482916.623820:0:9957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788482916.624329:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788482916.624355:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788482916.624366:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.624378:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482916.624389:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788482916.624392:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69c5051000 from 39 10000000:01000000:1.0:1788482916.624394:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482916.624424:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.624432:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.624455:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.624472:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593536:0@lo:101: 00000100:00100000:1.0:1788482916.624508:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.624528:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.624570:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593536 00000100:00100000:0.0:1788482916.624586:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593536 00000100:00100000:0.0:1788482916.624620:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788482916.624627:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098593536:12345-0@lo:101: 00010000:00010000:0.0:1788482916.624636:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482916.624649:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a488 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.624670:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.624679:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.624694:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030800, rc 0) 00000100:00100000:0.0:1788482916.624733:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098593536:12345-0@lo:101: Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.624739:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788482916.624849:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593536:0@lo:101: 00010000:00010000:1.0:1788482916.624861:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.624868:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.624912:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593664:0@lo:501: 00000100:00100000:1.0:1788482916.624935:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.624954:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.625040:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593664 00000100:00100000:0.0:1788482916.625045:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593664 00000100:00100000:0.0:1788482916.625063:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788482916.625069:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098593664:12345-0@lo:501: 00000100:00100000:0.0:1788482916.625409:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098593664:12345-0@lo:501: Request processed in 338us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.625416:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788482916.625513:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593664:0@lo:501: 00000100:00100000:1.0:1788482916.625540:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593792:0@lo:503: 00000100:00100000:1.0:1788482916.625691:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.625752:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.625779:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593792 00000100:00100000:2.0:1788482916.625784:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593792 00000100:00100000:2.0:1788482916.625840:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788482916.625854:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098593792:12345-0@lo:503: 00000100:00100000:2.0:1788482916.625937:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098593792:12345-0@lo:503: Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.625944:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788482916.626006:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098593792:0@lo:503: 00000100:00100000:1.0:1788482916.626468:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9958:1875360098593920:0@lo:502: 00000100:00100000:1.0:1788482916.626507:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.630784:0:9958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.630954:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098593920 00000100:00100000:0.0:1788482916.630966:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098593920 00000100:00100000:0.0:1788482916.631022:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788482916.631034:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:9958:x1875360098593920:12345-0@lo:502: 00000100:00100000:0.0:1788482916.631244:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:9958:x1875360098593920:12345-0@lo:502: Request processed in 212us (4734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.631253:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788482916.631423:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9958:1875360098593920:0@lo:502: 00000100:00100000:1.0:1788482916.631498:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9958:1875360098594048:0@lo:502: 00000100:00100000:1.0:1788482916.631545:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.631732:0:9958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482916.631787:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594048 00000100:00100000:3.0:1788482916.631792:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594048 00000100:00100000:3.0:1788482916.631822:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788482916.631830:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:9958:x1875360098594048:12345-0@lo:502: 00000100:00100000:3.0:1788482916.631931:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:9958:x1875360098594048:12345-0@lo:502: Request processed in 102us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.631939:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788482916.632290:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9958:1875360098594048:0@lo:502: 00000040:00080000:1.0:1788482916.632315:0:9958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788482916.632467:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788482916.632485:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788482916.632494:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.632504:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482916.632513:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788482916.632516:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69c5051000 from 6 10000000:01000000:3.0:1788482916.632519:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788482916.632547:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.632554:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.632563:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482916.634083:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594176:0@lo:101: 00000100:00100000:3.0:1788482916.634792:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.634839:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.634944:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594176 00000100:00100000:1.0:1788482916.634952:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594176 00000100:00100000:1.0:1788482916.635007:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788482916.635017:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098594176:12345-0@lo:101: 00010000:00010000:1.0:1788482916.635031:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482916.635050:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a49d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a496 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.635076:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a496 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.635086:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a496 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.635122:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2600, rc 0) 00000100:00100000:1.0:1788482916.635160:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098594176:12345-0@lo:101: Request processed in 145us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.635166:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788482916.635536:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594176:0@lo:101: 00010000:00010000:3.0:1788482916.635553:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.635727:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482916.635788:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594304:0@lo:256: 00000100:00100000:3.0:1788482916.635825:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.635903:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.635982:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594304 00000100:00100000:2.0:1788482916.635988:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594304 00000100:00100000:2.0:1788482916.636024:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788482916.636030:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098594304:12345-0@lo:256: 20000000:01000000:2.0:1788482916.636046:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788482916.636063:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788482916.636066:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788482916.636515:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098594304:12345-0@lo:256: Request processed in 483us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.636523:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788482916.636722:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594304:0@lo:256: 10000000:01000000:3.0:1788482916.636770:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788482916.636779:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.636788:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482916.636797:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788482916.636800:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788482916.636803:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788482916.636842:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.636849:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.636859:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482916.636874:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594432:0@lo:101: 00000100:00100000:3.0:1788482916.636910:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.637040:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.637077:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594432 00000100:00100000:2.0:1788482916.637083:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594432 00000100:00100000:2.0:1788482916.637711:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788482916.637724:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098594432:12345-0@lo:101: 00010000:00010000:2.0:1788482916.637737:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482916.637754:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a4a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482916.637777:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482916.637788:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482916.637796:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0a00, rc 0) 00000100:00100000:2.0:1788482916.637855:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098594432:12345-0@lo:101: Request processed in 135us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.637862:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788482916.637943:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594432:0@lo:101: 00010000:00010000:3.0:1788482916.637957:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.637965:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482916.638024:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594560:0@lo:501: 00000100:00100000:3.0:1788482916.638053:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.638394:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.638459:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594560 00000100:00100000:1.0:1788482916.638464:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594560 00000100:00100000:1.0:1788482916.638495:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788482916.638503:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098594560:12345-0@lo:501: 00000100:00100000:1.0:1788482916.638753:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098594560:12345-0@lo:501: Request processed in 250us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.638769:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788482916.639158:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594560:0@lo:501: 00000100:00100000:3.0:1788482916.639194:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594688:0@lo:503: 00000100:00100000:3.0:1788482916.639234:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.639257:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.639344:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594688 00000100:00100000:1.0:1788482916.639349:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594688 00000100:00100000:1.0:1788482916.639372:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788482916.639379:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098594688:12345-0@lo:503: 00000100:00100000:1.0:1788482916.639460:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098594688:12345-0@lo:503: Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.639466:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788482916.639541:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098594688:0@lo:503: 00000100:00100000:3.0:1788482916.640070:0:9959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9959:1875360098594816:0@lo:502: 00000100:00100000:3.0:1788482916.640146:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.640168:0:9959:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.640270:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594816 00000100:00100000:2.0:1788482916.640275:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594816 00000100:00100000:2.0:1788482916.640300:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788482916.640306:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:9959:x1875360098594816:12345-0@lo:502: 00000100:00100000:2.0:1788482916.640434:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:9959:x1875360098594816:12345-0@lo:502: Request processed in 127us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.640442:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788482916.640730:0:9959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9959:1875360098594816:0@lo:502: 00000020:01000000:1.0:1788482916.640755:0:9959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788482916.640763:0:9959:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788482916.640769:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.640771:0:9959:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788482916.640777:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788482916.640780:0:9959:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:1.0:1788482916.640801:0:9959:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788482916.640803:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788482916.640816:0:9959:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a69c55f4d28) 00000020:00000080:1.0:1788482916.640840:0:9959:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788482916.640844:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788482916.640976:0:9959:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788482916.640984:0:9959:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788482916.640991:0:9959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1a4b9 00010000:00080000:1.0:1788482916.641021:0:9959:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69efd42000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788482916.641323:0:9959:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788482916.641448:0:9959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788482916.641459:0:9959:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788482916.642153:0:9959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482916.642275:0:9959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482916.642406:0:9959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788482916.642494:0:9959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788482916.643459:0:9960:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788482916.643464:0:9960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788482916.651975:0:9959:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788482916.651989:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788482916.652036:0:9959:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788482916.652062:0:9959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1a4c0 00000100:00080000:1.0:1788482916.652075:0:9959:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482916.652081:0:9959:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69efd42000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482916.652132:0:9959:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c34ff480 x1875360098594944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788482916.652202:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098594944:0@lo:8: 00000100:00100000:3.0:1788482916.652268:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482916.652972:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098594944 00000100:00100000:2.0:1788482916.652982:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098594944 00000100:00100000:2.0:1788482916.653026:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788482916.653034:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098594944:12345-0@lo:8: 00010000:00080000:2.0:1788482916.653063:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788482916.653093:0:8411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1a4c7 00002000:00100000:2.0:1788482916.653133:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a68c33a7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788482916.653138:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788482916.653141:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788482916.653203:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788482916.653441:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788482916.653465:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a5000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788482916.653733:0:9959:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788482916.653858:0:9959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482916.653864:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.653866:0:9959:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788482916.653869:0:9959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482916.653873:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.653875:0:9959:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788482916.653878:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788482916.653879:0:9959:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788482916.653907:0:9959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9959:1875360098595072:0@lo:502: 00000100:00100000:1.0:1788482916.653955:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.653983:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595072 00000100:00100000:1.0:1788482916.653988:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595072 00000100:00100000:1.0:1788482916.654021:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788482916.654028:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:9959:x1875360098595072:12345-0@lo:502: 00000100:00100000:1.0:1788482916.654147:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:9959:x1875360098595072:12345-0@lo:502: Request processed in 118us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.654155:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788482916.654205:0:9959:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf1e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.654224:0:9959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9959:1875360098595072:0@lo:502: 00000020:01000000:1.0:1788482916.654245:0:9959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482916.654248:0:9959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.654250:0:9959:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788482916.654253:0:9959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1788482916.654372:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788482916.654391:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788482916.654401:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.654411:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482916.654420:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788482916.654423:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69d20cc000 from 39 10000000:01000000:1.0:1788482916.654425:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482916.654448:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.654455:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.654464:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.654475:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098595200:0@lo:101: 00000100:00100000:1.0:1788482916.654500:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.654514:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.655971:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098595712:0@lo:400: 00000100:00100000:0.0:1788482916.656027:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656055:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098596224:0@lo:400: 00000100:00100000:0.0:1788482916.656080:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656116:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788482916.656122:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098595328:0@lo:400: 00000100:00100000:0.0:1788482916.656183:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656212:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098595840:0@lo:400: 00000100:00100000:0.0:1788482916.656233:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656249:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098596352:0@lo:400: 00000100:00100000:0.0:1788482916.656266:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656306:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098595584:0@lo:400: 00000100:00100000:0.0:1788482916.656329:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656346:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098596096:0@lo:400: 00000100:00100000:0.0:1788482916.656367:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656385:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788482916.656391:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098595456:0@lo:400: 00000100:00100000:0.0:1788482916.656412:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656429:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098595968:0@lo:400: 00000100:00100000:0.0:1788482916.656449:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656458:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098596480:0@lo:400: 00000100:00100000:0.0:1788482916.656474:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.656493:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595712 00000100:00100000:0.0:1788482916.656499:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595712 00000100:00100000:0.0:1788482916.656541:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595456 00000100:00100000:0.0:1788482916.656544:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595456 00000100:00100000:0.0:1788482916.656558:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788482916.656565:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098595712:12345-0@lo:400: 00000100:00100000:0.0:1788482916.656638:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098595712:12345-0@lo:400: Request processed in 72us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.656645:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788482916.656660:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788482916.656666:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098595456:12345-0@lo:400: 00000100:00100000:0.0:1788482916.656704:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098595456:12345-0@lo:400: Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.656710:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788482916.656727:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596224 00000100:00100000:0.0:1788482916.656730:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596224 00000100:00100000:0.0:1788482916.656757:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596096 00000100:00100000:0.0:1788482916.656760:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596096 00000100:00100000:0.0:1788482916.656772:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482916.656778:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098596224:12345-0@lo:400: 00000100:00100000:0.0:1788482916.656805:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098596224:12345-0@lo:400: Request processed in 28us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.656811:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482916.656820:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482916.656825:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098596096:12345-0@lo:400: 00000100:00100000:0.0:1788482916.656846:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098596096:12345-0@lo:400: Request processed in 21us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.656852:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482916.656868:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595328 00000100:00100000:0.0:1788482916.656871:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595328 00000100:00100000:0.0:1788482916.656892:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595840 00000100:00100000:0.0:1788482916.656894:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595840 00000100:00100000:0.0:1788482916.656906:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596352 00000100:00100000:0.0:1788482916.656908:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596352 00000100:00100000:0.0:1788482916.656918:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595584 00000100:00100000:0.0:1788482916.656920:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595584 00000100:00100000:0.0:1788482916.656928:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595968 00000100:00100000:0.0:1788482916.656930:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595968 00000100:00100000:0.0:1788482916.656937:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596480 00000100:00100000:0.0:1788482916.656939:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596480 00000100:00100000:0.0:1788482916.656950:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482916.656965:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098595328:12345-0@lo:400: 00000100:00100000:0.0:1788482916.656995:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098595328:12345-0@lo:400: Request processed in 31us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.657000:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482916.657011:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788482916.657016:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098595840:12345-0@lo:400: 00000100:00100000:0.0:1788482916.657038:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098595840:12345-0@lo:400: Request processed in 22us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.657042:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788482916.657052:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788482916.657057:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098596352:12345-0@lo:400: 00000100:00100000:0.0:1788482916.657078:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098596352:12345-0@lo:400: Request processed in 22us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.657083:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788482916.657091:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788482916.657119:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098595584:12345-0@lo:400: 00000100:00100000:0.0:1788482916.657145:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098595584:12345-0@lo:400: Request processed in 49us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.657150:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788482916.657160:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788482916.657166:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098595968:12345-0@lo:400: 00000100:00100000:0.0:1788482916.657189:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098595968:12345-0@lo:400: Request processed in 23us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.657195:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788482916.657205:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788482916.657210:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098596480:12345-0@lo:400: 00000100:00100000:0.0:1788482916.657241:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098596480:12345-0@lo:400: Request processed in 32us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.657247:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788482916.657284:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788482916.657288:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788482916.657291:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482916.657321:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098595456:0@lo:400: 00010000:00080000:0.0:1788482916.657335:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376f100 x1875360098595968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657344:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098595968:0@lo:400: 00010000:00080000:0.0:1788482916.657352:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376ca80 x1875360098596480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657359:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098596480:0@lo:400: 00010000:00080000:0.0:1788482916.657367:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376df80 x1875360098595584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657374:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098595584:0@lo:400: 00010000:00080000:0.0:1788482916.657381:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376dc00 x1875360098596096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657387:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098596096:0@lo:400: 00010000:00080000:0.0:1788482916.657423:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376e300 x1875360098595328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657431:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098595328:0@lo:400: 00010000:00080000:0.0:1788482916.657439:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376c700 x1875360098595840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657454:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098595840:0@lo:400: 00010000:00080000:0.0:1788482916.657465:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376ed80 x1875360098596352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657473:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098596352:0@lo:400: 00000100:00100000:0.0:1788482916.657483:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098595712:0@lo:400: 00010000:00080000:0.0:1788482916.657491:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376c380 x1875360098596224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.657497:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098596224:0@lo:400: 00000100:00100000:0.0:1788482916.657521:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098595200 00000100:00100000:0.0:1788482916.657525:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098595200 00000100:00100000:0.0:1788482916.657553:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788482916.657559:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098595200:12345-0@lo:101: 00010000:00010000:0.0:1788482916.657569:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482916.657585:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a4ce expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.657635:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.657646:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.657657:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0031200, rc 0) 00000100:00100000:0.0:1788482916.657687:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098595200:12345-0@lo:101: Request processed in 128us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.657700:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788482916.657737:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098595200:0@lo:101: 00010000:00010000:0.0:1788482916.657752:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.657761:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482916.657820:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098596608:0@lo:501: 00000100:00100000:0.0:1788482916.657845:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.657860:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2621840 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.657872:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596608 00000100:00100000:0.0:1788482916.657875:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596608 00000100:00100000:0.0:1788482916.657895:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788482916.657900:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098596608:12345-0@lo:501: 00000100:00100000:0.0:1788482916.658001:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098596608:12345-0@lo:501: Request processed in 100us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.658008:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788482916.658036:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098596608:0@lo:501: 00000100:00100000:0.0:1788482916.658059:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098596736:0@lo:503: 00000100:00100000:0.0:1788482916.658114:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.658128:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2621840 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.658138:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596736 00000100:00100000:0.0:1788482916.658141:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596736 00000100:00100000:0.0:1788482916.658165:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788482916.658171:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098596736:12345-0@lo:503: 00000100:00100000:0.0:1788482916.658251:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098596736:12345-0@lo:503: Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.658257:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788482916.658295:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098596736:0@lo:503: 00000100:00100000:1.0:1788482916.659080:0:9962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9962:1875360098596864:0@lo:502: 00000100:00100000:1.0:1788482916.659163:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.659193:0:9962:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.659322:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596864 00000100:00100000:0.0:1788482916.659328:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596864 00000100:00100000:0.0:1788482916.659358:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788482916.659366:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:9962:x1875360098596864:12345-0@lo:502: 00000100:00100000:0.0:1788482916.659450:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:9962:x1875360098596864:12345-0@lo:502: Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.659456:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788482916.659543:0:9962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9962:1875360098596864:0@lo:502: 00000100:00100000:1.0:1788482916.659601:0:9962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9962:1875360098596992:0@lo:502: 00000100:00100000:1.0:1788482916.659646:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.659670:0:9962:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.659828:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098596992 00000100:00100000:0.0:1788482916.659832:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098596992 00000100:00100000:0.0:1788482916.659862:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788482916.659867:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:9962:x1875360098596992:12345-0@lo:502: 00000100:00100000:0.0:1788482916.659924:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:9962:x1875360098596992:12345-0@lo:502: Request processed in 57us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.659930:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788482916.659993:0:9962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9962:1875360098596992:0@lo:502: 00000040:00080000:1.0:1788482916.660011:0:9962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788482916.660176:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788482916.660194:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788482916.660203:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.660212:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482916.660222:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788482916.660230:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69d20cc000 from 6 10000000:01000000:0.0:1788482916.660233:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788482916.660254:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.660262:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.660281:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482916.660293:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597120:0@lo:101: 00000100:00100000:0.0:1788482916.660321:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.660352:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.660447:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098597120 00000100:00100000:1.0:1788482916.660452:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098597120 00000100:00100000:1.0:1788482916.660485:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788482916.660491:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098597120:12345-0@lo:101: 00010000:00010000:1.0:1788482916.660499:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482916.660512:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a4e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a4dc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.660530:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a4e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4dc expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.660540:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a4e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4dc expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.660548:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2000, rc 0) 00000100:00100000:1.0:1788482916.660592:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098597120:12345-0@lo:101: Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.660598:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788482916.660639:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597120:0@lo:101: 00010000:00010000:1.0:1788482916.660657:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.660665:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.660707:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597248:0@lo:256: 00000100:00100000:1.0:1788482916.660735:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.660754:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098597248 00000100:00100000:1.0:1788482916.660757:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098597248 00000100:00100000:1.0:1788482916.660778:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788482916.660783:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098597248:12345-0@lo:256: 20000000:01000000:1.0:1788482916.660793:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788482916.660810:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788482916.660813:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788482916.660876:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098597248:12345-0@lo:256: Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.660882:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788482916.660903:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.660912:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597248:0@lo:256: 10000000:01000000:1.0:1788482916.660952:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788482916.660957:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.660964:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482916.660970:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788482916.660976:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788482916.660978:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788482916.660992:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.660998:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.661005:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.661015:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597376:0@lo:101: 00000100:00100000:1.0:1788482916.661038:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.661056:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098597376 00000100:00100000:1.0:1788482916.661060:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098597376 00000100:00100000:1.0:1788482916.661079:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788482916.661084:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098597376:12345-0@lo:101: 00010000:00010000:1.0:1788482916.661090:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482916.661134:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a4ea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.661148:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.661155:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.661161:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3e00, rc 0) 00000100:00100000:1.0:1788482916.661183:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098597376:12345-0@lo:101: Request processed in 99us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.661196:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788482916.661224:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.661234:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597376:0@lo:101: 00010000:00010000:1.0:1788482916.661243:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.661250:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482916.661311:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597504:0@lo:501: 00000100:00100000:1.0:1788482916.661333:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.661348:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098597504 00000100:00100000:1.0:1788482916.661351:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098597504 00000100:00100000:1.0:1788482916.661369:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788482916.661375:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098597504:12345-0@lo:501: 00000100:00100000:1.0:1788482916.661474:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098597504:12345-0@lo:501: Request processed in 96us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.661481:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788482916.661503:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.661512:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597504:0@lo:501: 00000100:00100000:1.0:1788482916.661534:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597632:0@lo:503: 00000100:00100000:1.0:1788482916.661569:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.661585:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098597632 00000100:00100000:1.0:1788482916.661589:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098597632 00000100:00100000:1.0:1788482916.661621:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788482916.661628:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098597632:12345-0@lo:503: 00000100:00100000:1.0:1788482916.661699:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098597632:12345-0@lo:503: Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.661705:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788482916.661736:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.661747:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098597632:0@lo:503: 00000100:00100000:1.0:1788482916.661914:0:9963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9963:1875360098597760:0@lo:502: 00000100:00100000:1.0:1788482916.661946:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.661963:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098597760 00000100:00100000:1.0:1788482916.661966:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098597760 00000100:00100000:1.0:1788482916.661984:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788482916.661989:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:9963:x1875360098597760:12345-0@lo:502: 00000100:00100000:1.0:1788482916.662053:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:9963:x1875360098597760:12345-0@lo:502: Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.662058:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788482916.662081:0:9963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.662091:0:9963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9963:1875360098597760:0@lo:502: 00000020:01000000:1.0:1788482916.662131:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788482916.662137:0:9963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788482916.662143:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.662146:0:9963:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788482916.662150:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788482916.662154:0:9963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:1.0:1788482916.662173:0:9963:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788482916.662175:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788482916.662188:0:9963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a69c55f19b8) 00000020:00000080:1.0:1788482916.662218:0:9963:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788482916.662224:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788482916.662292:0:9963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788482916.662297:0:9963:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788482916.662304:0:9963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1a4ff 00010000:00080000:1.0:1788482916.662328:0:9963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c36b7800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788482916.662557:0:9963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788482916.662695:0:9963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788482916.662706:0:9963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788482916.662858:0:9963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482916.662959:0:9963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482916.663176:0:9963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788482916.663265:0:9963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:2.0:1788482916.664056:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098594944:12345-0@lo:8: Request processed in 11015us (11781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.664067:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788482916.664257:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34ff480 x1875360098594944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788482926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482916.664268:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482916.664292:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788482916.664299:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788482916.664303:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788482916.664307:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd42000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788482916.664315:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788482916.664320:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098594944:0@lo:8: 00000004:00080000:2.0:1788482916.664474:0:9960:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788482916.664530:0:9960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 208927432995ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788482916.664536:0:9960:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788482916.664601:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098597888:0@lo:700: 00000100:00100000:2.0:1788482916.664663:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788482916.668950:0:7424:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000040:00080000:3.0:1788482916.669900:0:9964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788482916.669907:0:9964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788482916.670749:0:9963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788482916.670762:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788482916.670808:0:9963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788482916.670835:0:9963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1a506 00000100:00080000:1.0:1788482916.670847:0:9963:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788482916.670852:0:9963:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a68c36b7800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788482916.670883:0:9963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c34fea00 x1875360098598016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788482916.670910:0:9963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788482916.670991:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482916.670995:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.670997:0:9963:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788482916.671000:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482916.671003:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.671004:0:9963:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788482916.671007:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788482916.671008:0:9963:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788482916.671034:0:9963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9963:1875360098598144:0@lo:502: 00000100:00100000:1.0:1788482916.671131:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.671170:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598144 00000100:00100000:1.0:1788482916.671176:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598144 00000100:00100000:1.0:1788482916.671210:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788482916.671218:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:9963:x1875360098598144:12345-0@lo:502: 00000100:00100000:0.0:1788482916.671468:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098598016:0@lo:8: 00000100:00100000:0.0:1788482916.671506:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.671547:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598016 00000100:00100000:0.0:1788482916.671550:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598016 00000100:00100000:0.0:1788482916.671568:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788482916.671573:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1875360098598016:12345-0@lo:8: 00010000:00080000:0.0:1788482916.671594:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1788482916.671629:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1a50d 00002000:00100000:0.0:1788482916.671642:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a68c33c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788482916.671646:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788482916.671649:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788482916.671717:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788482916.671739:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482916.671782:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098598016:12345-0@lo:8: Request processed in 208us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.671797:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788482916.671838:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fea00 x1875360098598016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788482926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.671846:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788482916.671853:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788482916.671858:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788482916.671862:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788482916.671864:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788482916.671868:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788482916.671872:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098598016:0@lo:8: 00000100:00100000:1.0:1788482916.672178:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:9963:x1875360098598144:12345-0@lo:502: Request processed in 960us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.672186:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788482916.672229:0:9963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf1e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.672242:0:9963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:9963:1875360098598144:0@lo:502: 00000020:01000000:1.0:1788482916.672264:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482916.672345:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482916.672348:0:9963:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788482916.672353:0:9963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:3.0:1788482916.672863:0:9964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:0.0:1788482916.673071:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788482916.673116:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788482916.673126:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.673137:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482916.673146:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788482916.673148:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a69f45ecd28 from 1 10000000:01000000:0.0:1788482916.673152:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788482916.673190:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.673197:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482916.673206:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482916.673231:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098598272:0@lo:101: 00000100:00100000:0.0:1788482916.673764:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.673800:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482916.673952:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598272 00000100:00100000:3.0:1788482916.673959:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598272 00000100:00100000:3.0:1788482916.674000:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788482916.674008:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098598272:12345-0@lo:101: 00010000:00010000:3.0:1788482916.674021:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482916.674034:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a514 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.674056:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.674065:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.674073:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77c00, rc 0) 00000100:00100000:3.0:1788482916.674139:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098598272:12345-0@lo:101: Request processed in 132us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.674145:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788482916.674188:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098598272:0@lo:101: 00010000:00010000:3.0:1788482916.674211:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.674220:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482916.674649:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098598400:0@lo:501: 00000100:00100000:3.0:1788482916.674682:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.674701:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.674760:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598400 00000100:00100000:0.0:1788482916.674765:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598400 00000100:00100000:0.0:1788482916.674799:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788482916.674806:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098598400:12345-0@lo:501: 00000100:00100000:0.0:1788482916.674873:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098598400:12345-0@lo:501: Request processed in 67us (189us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788482916.674880:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000004:00080000:1.0:1788482916.675292:0:9964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208938194306ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788482916.675302:0:9964:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788482916.675447:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098598400:0@lo:501: 10000000:01000000:3.0:1788482916.675477:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788482916.675484:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.675493:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482916.675698:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25f2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.675743:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098597888 00000100:00100000:1.0:1788482916.675749:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098597888 00000100:00100000:1.0:1788482916.675835:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788482916.675844:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9961:x1875360098597888:12345-0@lo:700: 00000100:00100000:1.0:1788482916.675884:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8419:1875360098598528:0@lo:700: 00000100:00100000:1.0:1788482916.675923:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.675948:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788482916.676135:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598528 00000100:00100000:2.0:1788482916.676140:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598528 00000100:00100000:2.0:1788482916.676170:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482916.676177:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8419:x1875360098598528:12345-0@lo:700: 00000100:00080000:0.0:1788482916.676503:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788482916.678212:0:9965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788482916.678241:0:9965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098598784:0@lo:7: 00000100:00100000:0.0:1788482916.678299:0:9965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.678327:0:9965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece42780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482916.678380:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482916.678395:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098598656:0@lo:13: 00000100:00100000:3.0:1788482916.678434:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.678528:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598784 00000100:00100000:1.0:1788482916.678535:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598784 00000100:00100000:1.0:1788482916.678592:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788482916.678600:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9965:x1875360098598784:12345-0@lo:7: 00000100:00100000:0.0:1788482916.678972:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598656 00000100:00100000:0.0:1788482916.678977:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598656 00000100:00100000:0.0:1788482916.679011:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788482916.679020:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098598656:12345-0@lo:13: 00002000:00000024:0.0:1788482916.679039:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:0.0:1788482916.679092:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098598656:12345-0@lo:13: Request processed in 72us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.679127:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788482916.679369:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788482916.679400:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd930a80 x1875360098598656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482916.679420:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098598656:0@lo:13: 00000004:00080000:3.0:1788482916.683460:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788482916.683569:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00002000:00080000:0.0:1788482916.688523:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788482916.688532:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788482916.688634:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9965:x1875360098598784:12345-0@lo:7: Request processed in 10030us (10330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.688651:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788482916.688771:0:9965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376c380 x1875360098598784/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482916.688797:0:9965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098598784:0@lo:7: 00000004:00080000:1.0:1788482916.688810:0:9965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788482916.688852:0:9965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098598912:0@lo:5: 00000100:00100000:1.0:1788482916.688886:0:9965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.688911:0:9965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf1e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482916.688957:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098598912 00000100:00100000:0.0:1788482916.688964:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098598912 00000100:00100000:0.0:1788482916.689045:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788482916.689054:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9965:x1875360098598912:12345-0@lo:5: 00002000:00080000:0.0:1788482916.689078:0:8409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788482916.689087:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788482916.692453:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788482916.692469:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788482916.692481:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788482916.692639:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9965:x1875360098598912:12345-0@lo:5: Request processed in 3582us (3748us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788482916.692650:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788482916.692735:0:9965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fe300 x1875360098598912/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482916.692748:0:9965:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788482916.692754:0:9965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098598912:0@lo:5: 00000004:00080000:1.0:1788482916.692768:0:9965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788482916.692813:0:9965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098599040:0@lo:700: 00000100:00100000:1.0:1788482916.692844:0:9965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.692878:0:9965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf1e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788482916.692919:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:3.0:1788482916.692927:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:3.0:1788482916.693248:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599040 00000100:00100000:3.0:1788482916.693256:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599040 00000100:00100000:0.0:1788482916.694085:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788482916.694137:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9965:x1875360098599040:12345-0@lo:700: 00000100:00100000:3.0:1788482916.698695:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8419:x1875360098598528:12345-0@lo:700: Request processed in 22509us (22762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.698709:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788482916.698977:0:8419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34ffb80 x1875360098598528/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482916.698994:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8419:1875360098598528:0@lo:700: 40000000:02000000:1.0:1788482916.699010:0:8419:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1788482916.725912:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9961:x1875360098597888:12345-0@lo:700: Request processed in 50062us (61240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482916.725927:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788482916.726064:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3077800 x1875360098597888/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482916.726079:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098597888:0@lo:700: 00000100:00100000:0.0:1788482916.734982:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098599168:0@lo:13: 00000100:00100000:0.0:1788482916.735059:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.735229:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599168 00000100:00100000:1.0:1788482916.735238:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599168 00000004:00080000:3.0:1788482916.735257:0:9961:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788482916.735285:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098599296:0@lo:7: 00000100:00100000:1.0:1788482916.735311:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788482916.735325:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482916.735326:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098599168:12345-0@lo:13: 00000100:00100000:3.0:1788482916.735344:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a23c0 going to sleep for 11 seconds 00002000:00000024:1.0:1788482916.735348:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:2.0:1788482916.735417:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599296 00000100:00100000:2.0:1788482916.735422:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599296 00000100:00100000:2.0:1788482916.735457:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788482916.735465:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9961:x1875360098599296:12345-0@lo:7: 00002000:00080000:3.0:1788482916.741204:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788482916.741213:0:8411:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788482916.741304:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9961:x1875360098599296:12345-0@lo:7: Request processed in 5836us (5979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.741314:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788482916.741368:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f14000 x1875360098599296/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482916.741381:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098599296:0@lo:7: 00000004:00080000:3.0:1788482916.741394:0:9961:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788482916.741426:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098599424:0@lo:5: 00000100:00100000:3.0:1788482916.741457:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482916.741489:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599424 00000100:00100000:3.0:1788482916.741500:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599424 00000100:00100000:3.0:1788482916.741540:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788482916.741548:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9961:x1875360098599424:12345-0@lo:5: 00002000:00080000:3.0:1788482916.741571:0:8551:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788482916.741678:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9961:x1875360098599424:12345-0@lo:5: Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.741684:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788482916.741705:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a23c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788482916.741717:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f14000 x1875360098599424/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482916.741725:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098599424:0@lo:5: 00000004:00080000:3.0:1788482916.741732:0:9961:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788482916.744441:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098599168:12345-0@lo:13: Request processed in 9112us (9372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.744472:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788482916.746989:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f14a80 x1875360098599168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.747016:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098599168:0@lo:13: 00000100:00100000:1.0:1788482916.750286:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9965:x1875360098599040:12345-0@lo:700: Request processed in 56184us (57432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.750301:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788482916.750309:0:9965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fe300 x1875360098599040/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.750325:0:9965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098599040:0@lo:700: 00000004:02000040:0.0:1788482916.756030:0:9965:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788482916.762246:0:9965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098599552:0@lo:5: 00000100:00100000:0.0:1788482916.762316:0:9965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482916.762353:0:9965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ece42780 going to sleep for 11 seconds 00000100:00100000:1.0:1788482916.762455:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599552 00000100:00100000:1.0:1788482916.762464:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599552 00000100:00100000:1.0:1788482916.762524:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788482916.762534:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9965:x1875360098599552:12345-0@lo:5: 00002000:00080000:2.0:1788482916.769972:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788482916.769995:0:8412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788482916.776056:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9965:x1875360098599552:12345-0@lo:5: Request processed in 13516us (13732us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788482916.776069:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788482916.778358:0:9965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376c700 x1875360098599552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482932 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482916.778394:0:9965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9965:1875360098599552:0@lo:5: 00000004:00080000:0.0:1788482916.778409:0:9965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:3.0:1788482917.138636:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788482917.496248:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788482917.997357:0:10016:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788482917.997646:0:10016:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788482918.136698:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482918.136722:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098599680:0@lo:13: 00000100:00100000:0.0:1788482918.136850:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482918.136957:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098599808:0@lo:41: 00000100:00100000:0.0:1788482918.136984:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482918.137020:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599680 00000100:00100000:0.0:1788482918.137028:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599680 00000100:00100000:0.0:1788482918.137079:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788482918.137087:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098599680:12345-0@lo:13: 00002000:00000024:0.0:1788482918.137136:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482918.137181:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098599680:12345-0@lo:13: Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482918.137188:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788482918.137210:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599808 00000100:00100000:0.0:1788482918.137214:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599808 00000100:00100000:0.0:1788482918.137239:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788482918.137245:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098599808:12345-0@lo:41: 00000004:00000024:0.0:1788482918.137267:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788482918.137346:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098599808:12345-0@lo:41: Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482918.137352:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788482918.137370:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482918.137406:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098599808:0@lo:41: 00010000:00080000:0.0:1788482918.137448:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34ffb80 x1875360098599680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482918.137461:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098599680:0@lo:13: 00000100:00100000:0.0:1788482918.138953:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098599936:0@lo:13: 00000100:00100000:0.0:1788482918.139011:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482918.139066:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098599936 00000100:00100000:0.0:1788482918.139073:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098599936 00000100:00100000:0.0:1788482918.139141:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788482918.139150:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098599936:12345-0@lo:13: 00002000:00000024:0.0:1788482918.139171:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482918.139213:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098599936:12345-0@lo:13: Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482918.139220:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788482918.139244:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482918.139267:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fdf80 x1875360098599936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482918.139283:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098599936:0@lo:13: 00010000:00010000:0.0:1788482918.526138:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788482918.890001:0:10064:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788482918.890011:0:10064:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788482919.498390:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482919.498765:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087015552 00000100:00100000:1.0:1788482919.498776:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087015552 00000100:00100000:1.0:1788482919.498827:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 181 00000100:00100000:1.0:1788482919.498836:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2389:x1875360087015552:12345-192.168.206.54@tcp:250: 00010000:00080000:1.0:1788482919.498865:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1c71c064-eed6-492d-871f-d947c33908cf@192.168.206.54@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1788482919.498897:0:6487:0:(genops.c:1385:class_connect()) connect: client 1c71c064-eed6-492d-871f-d947c33908cf, cookie 0x1d7ea3d89ea1a522 00000100:00080000:1.0:1788482919.499029:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482919.499088:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+5:2389:x1875360087015552:12345-192.168.206.54@tcp:250: Request processed in 251us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.499136:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 181 00000100:00100000:2.0:1788482919.509437:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482919.510268:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087015680 00000100:00100000:3.0:1788482919.510279:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087015680 00000100:00100000:3.0:1788482919.510373:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 182 00000100:00100000:3.0:1788482919.510382:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+5:6152:x1875360087015680:12345-192.168.206.54@tcp:101: 00010000:00010000:3.0:1788482919.510396:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482919.510411:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e0d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482919.510438:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482919.510449:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482919.510481:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77e00, rc 0) 00000100:00100000:3.0:1788482919.510550:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+6:6152:x1875360087015680:12345-192.168.206.54@tcp:101: Request processed in 168us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482919.510557:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 182 00000100:00100000:3.0:1788482919.516915:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482919.517877:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087015808 00000100:00100000:0.0:1788482919.517888:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087015808 00000100:00100000:0.0:1788482919.517948:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 183 00000100:00100000:0.0:1788482919.517958:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+6:6152:x1875360087015808:12345-192.168.206.54@tcp:501: 00000100:00100000:0.0:1788482919.518073:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+6:6152:x1875360087015808:12345-192.168.206.54@tcp:501: Request processed in 117us (1166us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788482919.518081:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 183 00000100:00100000:0.0:1788482919.522310:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482919.522482:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087015936 00000100:00100000:1.0:1788482919.522492:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087015936 00000100:00100000:1.0:1788482919.522804:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 184 00000100:00100000:1.0:1788482919.522816:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+6:6152:x1875360087015936:12345-192.168.206.54@tcp:101: 00010000:00010000:1.0:1788482919.522831:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482919.522863:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e0e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.522891:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.522901:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.522910:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3c00, rc 0) 00000100:00100000:1.0:1788482919.522971:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+7:6152:x1875360087015936:12345-192.168.206.54@tcp:101: Request processed in 157us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.522978:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 184 00000100:00100000:2.0:1788482919.528061:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482919.528181:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016064 00000100:00100000:3.0:1788482919.528191:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016064 00000100:00100000:3.0:1788482919.528249:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 185 00000100:00100000:3.0:1788482919.528259:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+7:6152:x1875360087016064:12345-192.168.206.54@tcp:501: 00000100:00100000:3.0:1788482919.528417:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+8:6152:x1875360087016064:12345-192.168.206.54@tcp:501: Request processed in 158us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482919.528424:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 185 00000100:00100000:3.0:1788482919.539046:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482919.540836:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016192 00000100:00100000:1.0:1788482919.540851:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016192 00000100:00100000:1.0:1788482919.540927:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 186 00000100:00100000:1.0:1788482919.540937:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+8:6152:x1875360087016192:12345-192.168.206.54@tcp:503: 00000100:00100000:1.0:1788482919.541168:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+8:6152:x1875360087016192:12345-192.168.206.54@tcp:503: Request processed in 231us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.541176:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 186 00010000:00010000:3.0:1788482919.544745:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482919.548200:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482919.548416:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016320 00000100:00100000:0.0:1788482919.548425:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016320 00000100:00100000:0.0:1788482919.548481:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 187 00000100:00100000:0.0:1788482919.548491:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+8:6171:x1875360087016320:12345-192.168.206.54@tcp:502: 00000100:00100000:0.0:1788482919.548928:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+8:6171:x1875360087016320:12345-192.168.206.54@tcp:502: Request processed in 436us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482919.548936:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 187 00000100:00100000:2.0:1788482919.597091:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482919.597288:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016448 00000100:00100000:3.0:1788482919.597298:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016448 00000100:00100000:3.0:1788482919.597353:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 188 00000100:00100000:3.0:1788482919.597363:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+8:6171:x1875360087016448:12345-192.168.206.54@tcp:502: 00000100:00100000:3.0:1788482919.597757:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+8:6171:x1875360087016448:12345-192.168.206.54@tcp:502: Request processed in 394us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482919.597765:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 188 00000100:00100000:3.0:1788482919.603288:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482919.608836:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016576 00000100:00100000:1.0:1788482919.608851:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016576 00000100:00100000:1.0:1788482919.608921:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 189 00000100:00100000:1.0:1788482919.608931:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+8:6152:x1875360087016576:12345-192.168.206.54@tcp:101: 00010000:00010000:1.0:1788482919.608948:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482919.608965:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e111 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.609009:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e111 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.609021:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e111 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.609030:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3200, rc 0) 00000100:00100000:1.0:1788482919.609154:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+9:6152:x1875360087016576:12345-192.168.206.54@tcp:101: Request processed in 223us (5874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.609161:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 189 00000100:00100000:1.0:1788482919.618468:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482919.618576:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016704 00000100:00100000:3.0:1788482919.618585:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016704 00000100:00100000:3.0:1788482919.618645:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 190 00000100:00100000:3.0:1788482919.618668:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+9:6152:x1875360087016704:12345-192.168.206.54@tcp:256: 20000000:01000000:3.0:1788482919.618692:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788482919.618709:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788482919.618712:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788482919.618715:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788482919.618717:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788482919.618720:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788482919.628833:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+9:6152:x1875360087016704:12345-192.168.206.54@tcp:256: Request processed in 10156us (10364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482919.628847:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 190 00000100:00100000:0.0:1788482919.635372:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482919.636978:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016832 00000100:00100000:1.0:1788482919.636994:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016832 00000100:00100000:1.0:1788482919.637058:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 191 00000100:00100000:1.0:1788482919.637068:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+9:6152:x1875360087016832:12345-192.168.206.54@tcp:101: 00010000:00010000:1.0:1788482919.637083:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482919.637136:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e118 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.637163:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.637173:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482919.637180:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a600, rc 0) 00000100:00100000:1.0:1788482919.637243:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:6152:x1875360087016832:12345-192.168.206.54@tcp:101: Request processed in 176us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.637263:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 191 00000100:00100000:1.0:1788482919.646432:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482919.647427:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087016960 00000100:00100000:3.0:1788482919.647437:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087016960 00000100:00100000:3.0:1788482919.647498:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 192 00000100:00100000:3.0:1788482919.647508:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6152:x1875360087016960:12345-192.168.206.54@tcp:501: 00000100:00100000:3.0:1788482919.647678:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6152:x1875360087016960:12345-192.168.206.54@tcp:501: Request processed in 170us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482919.647686:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 192 00000100:00100000:2.0:1788482919.656059:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482919.656180:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017088 00000100:00100000:3.0:1788482919.656190:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017088 00000100:00100000:3.0:1788482919.656252:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 193 00000100:00100000:3.0:1788482919.656262:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:6152:x1875360087017088:12345-192.168.206.54@tcp:503: 00000100:00100000:3.0:1788482919.656411:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:6152:x1875360087017088:12345-192.168.206.54@tcp:503: Request processed in 150us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482919.656420:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 193 00000100:00100000:0.0:1788482919.665202:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482919.665282:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017216 00000100:00100000:1.0:1788482919.665293:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017216 00000100:00100000:1.0:1788482919.665350:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 194 00000100:00100000:1.0:1788482919.665361:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:6179:x1875360087017216:12345-192.168.206.54@tcp:502: 00000100:00100000:1.0:1788482919.665524:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:6179:x1875360087017216:12345-192.168.206.54@tcp:502: Request processed in 164us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.665532:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 194 00000100:00100000:1.0:1788482919.674381:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482919.674491:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017344 00000100:00100000:0.0:1788482919.674500:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017344 00000100:00100000:0.0:1788482919.674560:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 195 00000100:00100000:0.0:1788482919.674579:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6179:x1875360087017344:12345-192.168.206.54@tcp:502: 00000100:00100000:0.0:1788482919.674741:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6179:x1875360087017344:12345-192.168.206.54@tcp:502: Request processed in 163us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482919.674750:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 195 00000100:00100000:0.0:1788482919.682053:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482919.682189:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482919.684306:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017472 00000100:00100000:1.0:1788482919.684320:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017472 00000100:00100000:2.0:1788482919.684368:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017728 00000100:00100000:2.0:1788482919.684383:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017728 00000100:00100000:2.0:1788482919.684417:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:2.0:1788482919.684425:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1875360087017472:12345-192.168.206.54@tcp:38: 00010000:00080000:2.0:1788482919.684452:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1788482919.684500:0:6493:0:(genops.c:1385:class_connect()) connect: client d93ec387-f41f-455a-afdd-b6a72a2f59de, cookie 0x1d7ea3d89ea1a545 00000004:00100000:2.0:1788482919.684534:0:6493:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00100000:0.0:1788482919.684780:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:0.0:1788482919.684798:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875360087017728:12345-192.168.206.54@tcp:38: 00010000:00080000:0.0:1788482919.684816:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1788482919.684901:0:6495:0:(genops.c:1385:class_connect()) connect: client d93ec387-f41f-455a-afdd-b6a72a2f59de, cookie 0x1d7ea3d89ea1a54c 00000004:00100000:0.0:1788482919.684913:0:6495:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788482919.685129:0:6495:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482919.685207:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2389:x1875360087017728:12345-192.168.206.54@tcp:38: Request processed in 419us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482919.685221:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00080000:2.0:1788482919.688093:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9a69ece23800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788482919.688185:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2389:x1875360087017472:12345-192.168.206.54@tcp:38: Request processed in 3758us (6139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482919.688194:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:3.0:1788482920.208760:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482920.208807:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482920.208902:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017856 00000100:00100000:0.0:1788482920.208911:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017856 00000100:00100000:0.0:1788482920.208995:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017600 00000100:00100000:0.0:1788482920.208999:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017600 00000100:00100000:2.0:1788482920.209009:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:2.0:1788482920.209023:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:0:x1875360087017856:12345-192.168.206.54@tcp:41: 00000004:00000024:2.0:1788482920.209062:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788482920.209066:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:0.0:1788482920.209076:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:0:x1875360087017600:12345-192.168.206.54@tcp:41: 00000004:00000024:0.0:1788482920.209122:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788482920.209153:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:0:x1875360087017856:12345-192.168.206.54@tcp:41: Request processed in 133us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482920.209162:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:0.0:1788482920.209167:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:0:x1875360087017600:12345-192.168.206.54@tcp:41: Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482920.209176:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00080000:1.0:1788482920.209713:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482920.209718:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788482920.216500:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482920.216727:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087017984 00000100:00100000:2.0:1788482920.216736:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087017984 00000100:00100000:2.0:1788482920.216795:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:2.0:1788482920.216804:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087017984:12345-192.168.206.54@tcp:41: 00000004:00000024:2.0:1788482920.216834:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788482920.216899:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087017984:12345-192.168.206.54@tcp:41: Request processed in 96us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482920.216907:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:0.0:1788482920.225854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482920.226071:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087018112 00000100:00100000:1.0:1788482920.226081:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087018112 00000100:00100000:1.0:1788482920.226169:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:1.0:1788482920.226180:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087018112:12345-192.168.206.54@tcp:40: 00000100:00100000:1.0:1788482920.226275:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087018112:12345-192.168.206.54@tcp:40: Request processed in 97us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482920.226283:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788482920.230659:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482920.230730:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482920.230768:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482920.230975:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087018496 00000100:00100000:2.0:1788482920.230985:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087018496 00000100:00100000:0.0:1788482920.230985:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087018240 00000100:00100000:0.0:1788482920.230992:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087018240 00000100:00100000:0.0:1788482920.231034:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087018368 00000100:00100000:0.0:1788482920.231038:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087018368 00000100:00100000:2.0:1788482920.231043:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:2.0:1788482920.231055:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087018496:12345-192.168.206.54@tcp:900: 00000100:00100000:0.0:1788482920.231065:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:0.0:1788482920.231071:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875360087018240:12345-192.168.206.54@tcp:8: 00010000:00080000:0.0:1788482920.231125:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1788482920.231158:0:8409:0:(genops.c:1385:class_connect()) connect: client d93ec387-f41f-455a-afdd-b6a72a2f59de, cookie 0x1d7ea3d89ea1a553 00000100:00100000:2.0:1788482920.231164:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087018496:12345-192.168.206.54@tcp:900: Request processed in 109us (431us total) trans 0 rc 0/0 00002000:00100000:0.0:1788482920.231171:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d93ec387-f41f-455a-afdd-b6a72a2f59de/ffff9a68c33c7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788482920.231176:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00002000:00100000:0.0:1788482920.231193:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:2.0:1788482920.231205:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:2.0:1788482920.231210:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875360087018368:12345-192.168.206.54@tcp:8: 00010000:00080000:2.0:1788482920.231229:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1788482920.231249:0:8412:0:(genops.c:1385:class_connect()) connect: client d93ec387-f41f-455a-afdd-b6a72a2f59de, cookie 0x1d7ea3d89ea1a55a 00002000:00100000:2.0:1788482920.231255:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d93ec387-f41f-455a-afdd-b6a72a2f59de/ffff9a69ece26000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788482920.231268:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788482920.231488:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788482920.231515:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9a69ece24800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788482920.231543:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2389:x1875360087018368:12345-192.168.206.54@tcp:8: Request processed in 331us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482920.231552:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00002000:00080000:0.0:1788482920.231648:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788482920.231675:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482920.231844:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2389:x1875360087018240:12345-192.168.206.54@tcp:8: Request processed in 636us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482920.231861:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:1.0:1788482920.239563:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482920.239652:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482920.239963:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087018624 00000100:00100000:3.0:1788482920.239974:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087018624 00000100:00100000:3.0:1788482920.240030:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 196 00000100:00100000:3.0:1788482920.240041:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087018624:12345-192.168.206.54@tcp:400: 00000100:00100000:3.0:1788482920.240139:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087018624:12345-192.168.206.54@tcp:400: Request processed in 100us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482920.240147:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 196 00000100:00100000:2.0:1788482920.240245:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087018752 00000100:00100000:2.0:1788482920.240250:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087018752 00000100:00100000:2.0:1788482920.240286:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:2.0:1788482920.240294:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087018752:12345-192.168.206.54@tcp:33: 00000004:00080000:0.0:1788482920.266290:0:6496:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25921us 00000004:00200000:0.0:1788482920.294039:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788482920.294178:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6152:x1875360087018752:12345-192.168.206.54@tcp:33: Request processed in 53877us (54624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482920.294193:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:1.0:1788482920.508086:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482920.508313:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087018880 00000100:00100000:2.0:1788482920.508323:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087018880 00000100:00100000:2.0:1788482920.508388:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:2.0:1788482920.508399:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6197:x1875360087018880:12345-192.168.206.54@tcp:101: 00010000:00010000:2.0:1788482920.508418:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482920.508503:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0e00/0x1d7ea3d89ea1a561 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e149 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482920.508577:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a568 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482920.508597:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482920.508611:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482920.508660:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788482920.508664:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788482920.508679:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482920.508704:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0e00/0x1d7ea3d89ea1a561 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e149 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482920.508721:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e149 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482920.508730:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df0bf900) 00010000:00010000:2.0:1788482920.508733:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788482920.508737:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1000, rc 0) 00000100:00100000:2.0:1788482920.508804:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:6197:x1875360087018880:12345-192.168.206.54@tcp:101: Request processed in 398us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482920.508812:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00010000:00010000:1.0:1788482920.568268:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482920.700869:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482920.700904:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098600064:0@lo:41: 00000100:00100000:3.0:1788482920.700968:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482920.701679:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600064 00000100:00100000:2.0:1788482920.701702:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600064 00000100:00100000:2.0:1788482920.701772:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788482920.701783:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098600064:12345-0@lo:41: 00000004:00000024:2.0:1788482920.701812:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788482920.701889:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098600064:12345-0@lo:41: Request processed in 98us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482920.701897:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788482920.702054:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098600064:0@lo:41: 00010000:00010000:0.0:1788482921.596417:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482921.720392:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482921.720416:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098600192:0@lo:13: 00000100:00100000:1.0:1788482921.720530:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482921.720705:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600192 00000100:00100000:3.0:1788482921.720713:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600192 00000100:00100000:3.0:1788482921.720770:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788482921.720780:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098600192:12345-0@lo:13: 00002000:00000024:3.0:1788482921.720802:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482921.720848:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098600192:12345-0@lo:13: Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482921.720854:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788482921.720972:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788482921.720999:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f14e00 x1875360098600192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482921.721010:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788482921.721031:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098600192:0@lo:13: 00000100:00100000:1.0:1788482921.721413:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098600320:0@lo:400: 00000100:00100000:1.0:1788482921.721447:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482921.721477:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098600832:0@lo:400: 00000100:00100000:1.0:1788482921.721508:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482921.721523:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098601344:0@lo:400: 00000100:00100000:1.0:1788482921.721542:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482921.721557:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788482921.721562:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098600448:0@lo:400: 00000100:00100000:1.0:1788482921.721595:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482921.721610:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098600960:0@lo:400: 00000100:00100000:1.0:1788482921.721629:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482921.721644:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098601472:0@lo:400: 00000100:00100000:1.0:1788482921.721661:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482921.721683:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600448 00000100:00100000:1.0:1788482921.721687:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600448 00000100:00100000:1.0:1788482921.721712:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600960 00000100:00100000:1.0:1788482921.721714:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600960 00000100:00100000:1.0:1788482921.721730:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601472 00000100:00100000:1.0:1788482921.721739:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601472 00000100:00100000:1.0:1788482921.721760:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788482921.721766:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098600448:12345-0@lo:400: 00000100:00100000:1.0:1788482921.721804:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098600448:12345-0@lo:400: Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482921.721811:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788482921.721823:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788482921.721829:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098600960:12345-0@lo:400: 00000100:00100000:1.0:1788482921.721853:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098600960:12345-0@lo:400: Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482921.721859:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788482921.721871:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788482921.722037:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601344 00000100:00100000:2.0:1788482921.722042:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601344 00000100:00100000:2.0:1788482921.722086:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788482921.722114:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098601344:12345-0@lo:400: 00000100:00100000:2.0:1788482921.722151:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098601344:12345-0@lo:400: Request processed in 59us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482921.722158:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788482921.722185:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098600704:0@lo:400: 00000100:00100000:2.0:1788482921.722244:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482921.722257:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098601216:0@lo:400: 00000100:00100000:2.0:1788482921.722277:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482921.722291:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098601728:0@lo:400: 00000100:00100000:2.0:1788482921.722307:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482921.722322:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788482921.722328:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098600576:0@lo:400: 00000100:00100000:2.0:1788482921.722346:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482921.722361:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098601088:0@lo:400: 00000100:00100000:2.0:1788482921.722378:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482921.722388:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098601600:0@lo:400: 00000100:00100000:2.0:1788482921.722422:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482921.722441:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600832 00000100:00100000:2.0:1788482921.722445:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600832 00000100:00100000:2.0:1788482921.722467:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600576 00000100:00100000:2.0:1788482921.722470:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600576 00000100:00100000:2.0:1788482921.722495:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788482921.722502:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098600832:12345-0@lo:400: 00000100:00100000:2.0:1788482921.722533:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098600832:12345-0@lo:400: Request processed in 32us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482921.722540:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788482921.722551:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788482921.722557:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098600576:12345-0@lo:400: 00000100:00100000:2.0:1788482921.722599:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098600576:12345-0@lo:400: Request processed in 41us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482921.722605:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788482921.722633:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098600576:0@lo:400: 00000100:00100000:2.0:1788482921.722653:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600704 00000100:00100000:2.0:1788482921.722657:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600704 00000100:00100000:2.0:1788482921.722670:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601088 00000100:00100000:2.0:1788482921.722672:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601088 00000100:00100000:2.0:1788482921.722682:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601600 00000100:00100000:2.0:1788482921.722685:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601600 00000100:00100000:2.0:1788482921.722696:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788482921.722702:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098600704:12345-0@lo:400: 00000100:00100000:2.0:1788482921.722733:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098600704:12345-0@lo:400: Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482921.722739:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788482921.722750:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788482921.722762:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098601088:12345-0@lo:400: 00000100:00100000:2.0:1788482921.722789:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098601088:12345-0@lo:400: Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482921.722795:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788482921.722805:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788482921.722811:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098601600:12345-0@lo:400: 00000100:00100000:2.0:1788482921.722833:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098601600:12345-0@lo:400: Request processed in 22us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482921.722838:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788482921.722861:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f5c00 x1875360098601088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482921.722873:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098601088:0@lo:400: 00000100:00100000:1.0:1788482921.723173:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098601472:12345-0@lo:400: 00000100:00100000:1.0:1788482921.723208:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098601472:12345-0@lo:400: Request processed in 1332us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482921.723215:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788482921.723236:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788482921.723240:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482921.723243:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482921.723262:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098600448:0@lo:400: 00000100:00100000:1.0:1788482921.723274:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098600960:0@lo:400: 00000100:00100000:1.0:1788482921.723284:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098601472:0@lo:400: 00000100:00100000:1.0:1788482921.723294:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098600832:0@lo:400: 00010000:00080000:1.0:1788482921.723304:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f6d80 x1875360098601344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482921.723327:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098601344:0@lo:400: 00000100:00100000:3.0:1788482921.724003:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601216 00000100:00100000:3.0:1788482921.724009:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601216 00000100:00100000:3.0:1788482921.724058:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601728 00000100:00100000:3.0:1788482921.724062:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601728 00000100:00100000:3.0:1788482921.724081:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482921.724089:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098601216:12345-0@lo:400: 00000100:00100000:3.0:1788482921.724159:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098601216:12345-0@lo:400: Request processed in 70us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482921.724165:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482921.724179:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788482921.724186:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098601728:12345-0@lo:400: 00000100:00100000:3.0:1788482921.724210:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098601728:12345-0@lo:400: Request processed in 25us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482921.724216:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788482921.724278:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482921.724282:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482921.724345:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098600320 00000100:00100000:0.0:1788482921.724350:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098600320 00000100:00100000:0.0:1788482921.724385:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788482921.724392:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098600320:12345-0@lo:400: 00000100:00100000:0.0:1788482921.724435:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098600320:12345-0@lo:400: Request processed in 44us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482921.724441:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:2.0:1788482921.725641:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f4000 x1875360098601600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482921.725656:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098601600:0@lo:400: 00000100:00100000:2.0:1788482921.725671:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098600704:0@lo:400: 00010000:00080000:2.0:1788482921.725682:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f4380 x1875360098601216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482921.725691:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098601216:0@lo:400: 00010000:00080000:2.0:1788482921.725702:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f5180 x1875360098601728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482921.725710:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098601728:0@lo:400: 00000100:00100000:1.0:1788482921.728789:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098600320:0@lo:400: 00000100:00100000:3.0:1788482922.234092:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098601984:0@lo:5: 00000100:00100000:3.0:1788482922.234195:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482922.234272:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482922.234291:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601984 00000100:00100000:3.0:1788482922.234298:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601984 00000100:00100000:3.0:1788482922.234347:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788482922.234357:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9961:x1875360098601984:12345-0@lo:5: 00002000:00080000:3.0:1788482922.234397:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788482922.236127:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9961:x1875360098601984:12345-0@lo:5: Request processed in 1735us (1897us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788482922.236139:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788482922.236198:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f15f80 x1875360098601984/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482938 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482922.236214:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875360098601984:0@lo:5: 00000004:00080000:3.0:1788482922.236226:0:9961:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788482922.236315:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098601856:0@lo:13: 00000100:00100000:1.0:1788482922.236360:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482922.236406:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098601856 00000100:00100000:1.0:1788482922.236412:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098601856 00000100:00100000:1.0:1788482922.236448:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788482922.236456:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875360098601856:12345-0@lo:13: 00002000:00000024:1.0:1788482922.236472:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482922.236503:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875360098601856:12345-0@lo:13: Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482922.236509:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788482922.236537:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f15880 x1875360098601856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482922.236551:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098601856:0@lo:13: 00000100:00100000:3.0:1788482922.245864:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9961:1875360098602112:0@lo:900: 00000100:00100000:3.0:1788482922.245936:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482922.246001:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788482922.246914:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098602112 00000100:00100000:2.0:1788482922.246944:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098602112 00000100:00100000:2.0:1788482922.247014:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482922.247023:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9961:x1875360098602112:12345-0@lo:900: 00000100:00100000:2.0:1788482922.247143:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9961:x1875360098602112:12345-0@lo:900: Request processed in 121us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482922.247150:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788482922.247470:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9961:1875360098602112:0@lo:900: 00010000:00010000:3.0:1788482922.618599:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482922.791597:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482922.791752:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019008 00000100:00100000:2.0:1788482922.791761:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019008 00000100:00100000:2.0:1788482922.791905:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:2.0:1788482922.791917:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:6249:x1875360087019008:12345-192.168.206.54@tcp:41: 00000004:00000024:2.0:1788482922.791953:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:1.0:1788482922.792065:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482922.792122:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:6249:x1875360087019008:12345-192.168.206.54@tcp:41: Request processed in 207us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482922.792129:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:1.0:1788482922.795262:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482922.795396:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019136 00000100:00100000:3.0:1788482922.795405:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019136 00000100:00100000:3.0:1788482922.795468:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:3.0:1788482922.795479:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6249:x1875360087019136:12345-192.168.206.54@tcp:41: 00000004:00000024:3.0:1788482922.795510:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482922.795583:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6249:x1875360087019136:12345-192.168.206.54@tcp:41: Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482922.795590:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00080000:1.0:1788482922.795940:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788482922.800866:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482922.800968:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019264 00000100:00100000:1.0:1788482922.800979:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019264 00000100:00100000:1.0:1788482922.801054:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:1.0:1788482922.801064:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6249:x1875360087019264:12345-192.168.206.54@tcp:13: 00002000:00000024:1.0:1788482922.801122:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482922.801200:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6249:x1875360087019264:12345-192.168.206.54@tcp:13: Request processed in 138us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482922.801207:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00080000:2.0:1788482922.801282:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482922.805887:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482922.806360:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019392 00000100:00100000:1.0:1788482922.806369:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019392 00000100:00100000:1.0:1788482922.806439:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:1.0:1788482922.806450:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6249:x1875360087019392:12345-192.168.206.54@tcp:13: 00002000:00000024:1.0:1788482922.806474:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482922.806540:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:6249:x1875360087019392:12345-192.168.206.54@tcp:13: Request processed in 92us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482922.806548:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00080000:2.0:1788482922.810490:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482923.260810:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482923.260833:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098602240:0@lo:13: 00000100:00100000:0.0:1788482923.260915:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482923.261159:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098602240 00000100:00100000:1.0:1788482923.261176:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098602240 00000100:00100000:1.0:1788482923.261222:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788482923.261230:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098602240:12345-0@lo:13: 00002000:00000024:1.0:1788482923.261249:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482923.261288:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098602240:12345-0@lo:13: Request processed in 59us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482923.261295:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788482923.261338:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f6a00 x1875360098602240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482923.261356:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098602240:0@lo:13: 00000100:00080000:2.0:1788482923.263606:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482923.263634:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098602496:0@lo:41: 00000100:00100000:2.0:1788482923.263703:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482923.263768:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482923.263775:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098602368:0@lo:13: 00000100:00100000:2.0:1788482923.263801:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482923.264075:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098602496 00000100:00100000:3.0:1788482923.264083:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098602496 00000100:00100000:3.0:1788482923.264167:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788482923.264177:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098602496:12345-0@lo:41: 00000004:00000024:3.0:1788482923.264201:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482923.264259:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098602496:12345-0@lo:41: Request processed in 83us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482923.264266:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788482923.265488:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098602496:0@lo:41: 00000100:00100000:1.0:1788482923.267227:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098602368 00000100:00100000:1.0:1788482923.267239:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098602368 00000100:00080000:3.0:1788482923.267317:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482923.267326:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788482923.267339:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098602368:12345-0@lo:13: 00002000:00000024:1.0:1788482923.267378:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482923.267467:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098602368:12345-0@lo:13: Request processed in 130us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482923.267473:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788482923.267529:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb85500 x1875360098602368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482923.267548:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098602368:0@lo:13: 00010000:00010000:3.0:1788482923.644084:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482924.664383:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788482924.794372:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1788482924.794389:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00010000:00010000:3.0:1788482925.702959:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482925.710138:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482925.710191:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482925.710223:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482925.710245:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482925.710274:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482925.710308:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019776 00000100:00100000:3.0:1788482925.710320:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019776 00000100:00100000:3.0:1788482925.710385:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019648 00000100:00100000:3.0:1788482925.710389:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019648 00000100:00100000:3.0:1788482925.710420:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:3.0:1788482925.710431:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087019776:12345-192.168.206.54@tcp:400: 00000100:00100000:3.0:1788482925.710524:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087019776:12345-192.168.206.54@tcp:400: Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482925.710533:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:3.0:1788482925.710572:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:3.0:1788482925.710579:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2390:x1875360087019648:12345-192.168.206.54@tcp:400: 00000100:00100000:3.0:1788482925.710605:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2390:x1875360087019648:12345-192.168.206.54@tcp:400: Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482925.710611:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:3.0:1788482925.710632:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020032 00000100:00100000:3.0:1788482925.710636:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020032 00000100:00100000:3.0:1788482925.710662:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019904 00000100:00100000:3.0:1788482925.710665:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019904 00000100:00100000:3.0:1788482925.710696:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788482925.710704:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020032:12345-192.168.206.54@tcp:400: 00000100:00100000:3.0:1788482925.710731:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020032:12345-192.168.206.54@tcp:400: Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482925.710759:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788482925.710771:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:3.0:1788482925.710777:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087019904:12345-192.168.206.54@tcp:400: 00000100:00100000:3.0:1788482925.710809:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087019904:12345-192.168.206.54@tcp:400: Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482925.710816:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00080000:3.0:1788482925.710840:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482925.710845:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482925.710848:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482925.710851:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788482925.711394:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087019520 00000100:00100000:1.0:1788482925.711403:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087019520 00000100:00100000:1.0:1788482925.711453:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 198 00000100:00100000:1.0:1788482925.711462:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087019520:12345-192.168.206.54@tcp:400: 00000100:00100000:1.0:1788482925.711509:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087019520:12345-192.168.206.54@tcp:400: Request processed in 48us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482925.711516:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 198 00000100:00100000:1.0:1788482925.817649:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482925.817684:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098602624:0@lo:41: 00000100:00100000:1.0:1788482925.817773:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1788482925.820736:0:7424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000100:00100000:0.0:1788482925.820739:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098602624 00000100:00100000:0.0:1788482925.820756:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098602624 00000100:00100000:0.0:1788482925.820827:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788482925.820840:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098602624:12345-0@lo:41: 00000004:00000024:0.0:1788482925.820887:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788482925.821000:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098602624:12345-0@lo:41: Request processed in 163us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482925.821025:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788482925.821130:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098602624:0@lo:41: 00000001:00100000:0.0:1788482925.827671:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000001:00100000:1.0:1788482925.831035:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000001:02000400:2.0:1788482925.890813:0:10162:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788482926.715599:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482926.840574:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098602880:0@lo:400: 00000100:00100000:3.0:1788482926.840703:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.840824:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482926.840843:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098602752:0@lo:400: 00000100:00100000:0.0:1788482926.840886:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.840938:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098602752 00000100:00100000:0.0:1788482926.840948:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098602752 00000100:00100000:0.0:1788482926.841020:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788482926.841031:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098602752:12345-0@lo:400: 00000100:00100000:0.0:1788482926.841090:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098602752:12345-0@lo:400: Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482926.841132:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788482926.841195:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098602752:0@lo:400: 00000100:00100000:0.0:1788482926.841652:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098603008:0@lo:400: 00000100:00100000:0.0:1788482926.841695:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.841736:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603008 00000100:00100000:0.0:1788482926.841742:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603008 00000100:00100000:0.0:1788482926.841780:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788482926.841788:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098603008:12345-0@lo:400: 00000100:00100000:0.0:1788482926.841835:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098603008:12345-0@lo:400: Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482926.841841:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788482926.841876:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098603008:0@lo:400: 00000100:00100000:3.0:1788482926.842302:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098602880 00000100:00100000:3.0:1788482926.842308:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098602880 00000100:00100000:3.0:1788482926.842346:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788482926.842354:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098602880:12345-0@lo:400: 00000100:00100000:3.0:1788482926.842406:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098602880:12345-0@lo:400: Request processed in 53us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482926.842412:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788482926.842469:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098602880:0@lo:400: 00000100:00100000:0.0:1788482926.842696:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482926.842710:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098603136:0@lo:13: 00000100:00100000:0.0:1788482926.842765:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.842798:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603136 00000100:00100000:0.0:1788482926.842802:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603136 00000100:00100000:0.0:1788482926.842842:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788482926.842849:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098603136:12345-0@lo:13: 00002000:00000024:0.0:1788482926.842876:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482926.842916:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098603136:12345-0@lo:13: Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482926.842923:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788482926.842943:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788482926.842968:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f6300 x1875360098603136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482926.843002:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098603136:0@lo:13: 00000100:00100000:0.0:1788482926.843782:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098603520:0@lo:400: 00000100:00100000:0.0:1788482926.843834:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.843868:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098604032:0@lo:400: 00000100:00100000:0.0:1788482926.843892:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.843915:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788482926.843921:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098603392:0@lo:400: 00000100:00100000:0.0:1788482926.843947:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.843964:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098603904:0@lo:400: 00000100:00100000:0.0:1788482926.844002:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482926.844037:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603520 00000100:00100000:0.0:1788482926.844044:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603520 00000100:00100000:0.0:1788482926.844242:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098604032 00000100:00100000:0.0:1788482926.844246:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098604032 00000100:00100000:0.0:1788482926.844273:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788482926.844300:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098603520:12345-0@lo:400: 00000100:00100000:0.0:1788482926.844359:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098603520:12345-0@lo:400: Request processed in 61us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482926.844366:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788482926.844382:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788482926.844388:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098604032:12345-0@lo:400: 00000100:00100000:0.0:1788482926.844415:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098604032:12345-0@lo:400: Request processed in 27us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482926.844502:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788482926.844645:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098603648:0@lo:400: 00000100:00100000:3.0:1788482926.844685:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482926.844707:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098604160:0@lo:400: 00000100:00100000:3.0:1788482926.844729:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482926.844755:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788482926.844762:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098603264:0@lo:400: 00000100:00100000:3.0:1788482926.844787:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482926.844798:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098603776:0@lo:400: 00000100:00100000:3.0:1788482926.844819:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482926.844837:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098604288:0@lo:400: 00000100:00100000:3.0:1788482926.844857:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482926.844886:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603904 00000100:00100000:3.0:1788482926.844891:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603904 00000100:00100000:3.0:1788482926.844924:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603776 00000100:00100000:3.0:1788482926.844926:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603776 00000100:00100000:3.0:1788482926.844939:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098604288 00000100:00100000:3.0:1788482926.844941:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098604288 00000100:00100000:3.0:1788482926.844956:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788482926.844962:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098603904:12345-0@lo:400: 00000100:00100000:0.0:1788482926.845145:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603392 00000100:00100000:0.0:1788482926.845150:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603392 00000100:00100000:0.0:1788482926.845179:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788482926.845185:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098603392:12345-0@lo:400: 00000100:00100000:0.0:1788482926.845225:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098603392:12345-0@lo:400: Request processed in 40us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482926.845232:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788482926.845256:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788482926.845263:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098603776:12345-0@lo:400: 00000100:00100000:0.0:1788482926.845300:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098603776:12345-0@lo:400: Request processed in 38us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482926.845306:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482926.845366:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098603904:12345-0@lo:400: Request processed in 403us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482926.845372:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788482926.845383:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788482926.845390:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098604288:12345-0@lo:400: 00000100:00100000:3.0:1788482926.845497:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098604288:12345-0@lo:400: Request processed in 30us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482926.845503:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788482926.845706:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603648 00000100:00100000:2.0:1788482926.845712:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603648 00000100:00100000:2.0:1788482926.845744:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098604160 00000100:00100000:2.0:1788482926.845747:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098604160 00000100:00100000:2.0:1788482926.845758:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098603264 00000100:00100000:2.0:1788482926.845760:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098603264 00000100:00100000:2.0:1788482926.845770:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788482926.845776:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098603648:12345-0@lo:400: 00000100:00100000:2.0:1788482926.845809:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098603648:12345-0@lo:400: Request processed in 34us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482926.845814:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788482926.845824:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788482926.845828:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098604160:12345-0@lo:400: 00000100:00100000:2.0:1788482926.845848:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098604160:12345-0@lo:400: Request processed in 20us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482926.845853:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788482926.845861:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788482926.845865:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098603264:12345-0@lo:400: 00000100:00100000:2.0:1788482926.845884:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098603264:12345-0@lo:400: Request processed in 19us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482926.845889:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788482926.846133:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788482926.846139:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482926.846142:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482926.846144:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482926.846219:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098603392:0@lo:400: 00010000:00080000:1.0:1788482926.846240:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f3a300 x1875360098603904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482926.846252:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098603904:0@lo:400: 00000100:00100000:1.0:1788482926.846281:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098603520:0@lo:400: 00000100:00100000:1.0:1788482926.846292:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098604032:0@lo:400: 00000100:00100000:1.0:1788482926.846361:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098603264:0@lo:400: 00010000:00080000:1.0:1788482926.846373:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f3aa00 x1875360098603776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482926.846382:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098603776:0@lo:400: 00010000:00080000:1.0:1788482926.846393:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd934380 x1875360098604288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482926.846400:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788482926.846412:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098604288:0@lo:400: 00010000:00080000:1.0:1788482926.847318:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c59e5c00 x1875360098603648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482926.847338:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098603648:0@lo:400: 00010000:00080000:0.0:1788482926.849669:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd937100 x1875360098604160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482926.849694:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098604160:0@lo:400: 00000100:00100000:1.0:1788482927.352404:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098604416:0@lo:13: 00000100:00100000:1.0:1788482927.352513:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482927.352770:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098604416 00000100:00100000:3.0:1788482927.352781:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098604416 00000100:00100000:3.0:1788482927.352851:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482927.352863:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098604416:12345-0@lo:13: 00002000:00000024:3.0:1788482927.352892:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482927.352967:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098604416:12345-0@lo:13: Request processed in 104us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482927.352975:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788482927.353021:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37fb100 x1875360098604416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482927.353042:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098604416:0@lo:13: 00010000:00010000:0.0:1788482927.736355:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482928.376749:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098604544:0@lo:41: 00000100:00100000:3.0:1788482928.376845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482928.376959:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788482928.376975:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098604672:0@lo:13: 00000100:00100000:2.0:1788482928.377008:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482928.377633:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098604672 00000100:00100000:3.0:1788482928.377643:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098604672 00000100:00100000:3.0:1788482928.377721:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788482928.377733:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098604672:12345-0@lo:13: 00002000:00000024:3.0:1788482928.377767:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482928.377834:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098604672:12345-0@lo:13: Request processed in 103us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482928.377841:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788482928.377903:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd935880 x1875360098604672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482928.377924:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098604672:0@lo:13: 00000100:00080000:0.0:1788482928.378939:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482928.380254:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482928.380286:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098604800:0@lo:13: 00000100:00100000:0.0:1788482928.380375:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482928.381368:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098604800 00000100:00100000:3.0:1788482928.381384:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098604800 00000100:00100000:3.0:1788482928.381460:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788482928.381472:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098604800:12345-0@lo:13: 00002000:00000024:3.0:1788482928.381506:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482928.381597:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098604800:12345-0@lo:13: Request processed in 126us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482928.381617:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788482928.381722:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482928.381879:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37f8380 x1875360098604800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482928.381904:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098604800:0@lo:13: 00000100:00100000:2.0:1788482928.384044:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098604544 00000100:00100000:2.0:1788482928.384061:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098604544 00000100:00100000:2.0:1788482928.384339:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788482928.384352:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098604544:12345-0@lo:41: 00000004:00000024:2.0:1788482928.384399:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788482928.384516:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098604544:12345-0@lo:41: Request processed in 166us (7670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482928.384524:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788482928.384613:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098604544:0@lo:41: 00010000:00010000:3.0:1788482928.765732:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482929.785188:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788482930.059978:0:10310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff48c55530 20000000:00000080:2.0:1788482930.059998:0:10310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a69c5907c00 uarg=0000000000000000 20000000:01000000:2.0:1788482930.060051:0:10310:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788482930.060053:0:10310:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788482930.060057:0:10310:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788482930.060062:0:10310:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788482930.060068:0:10310:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788482930.060183:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788482930.060186:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788482930.065807:0:10311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788482930.066325:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788482930.066363:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788482930.066378:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788482930.066391:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788482930.066394:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788482930.066894:0:10312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788482930.067133:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788482930.067163:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788482930.067178:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1788482930.067189:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788482930.067191:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788482930.067576:0:10313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788482930.067896:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788482930.067925:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788482930.067941:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788482930.067951:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788482930.067953:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788482930.069291:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788482930.069617:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788482930.069650:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788482930.069665:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788482930.069679:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788482930.069682:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788482930.073971:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788482930.074420:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788482930.074459:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788482930.074476:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:0.0:1788482930.074491:0:10310:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788482930.074516:0:10310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074554:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074580:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074588:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074595:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074601:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074608:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074615:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074623:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074630:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074640:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074647:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074666:0:10310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074719:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.074736:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 9 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.074755:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098604928:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788482930.075008:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075017:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 9 pid: 6488 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.075025:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605056:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788482930.075061:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075069:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.075079:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605184:0@lo:104: 00000100:00100000:0.0:1788482930.075174:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482930.075220:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075240:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 23 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.075249:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605312:0@lo:104: 00000100:00100000:0.0:1788482930.075274:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.075312:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098605184 00000100:00100000:0.0:1788482930.075321:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098605184 00000100:00100000:0.0:1788482930.075378:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098605312 00000100:00100000:0.0:1788482930.075381:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098605312 00000100:00100000:0.0:1788482930.075396:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482930.075405:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:10310:x1875360098605184:12345-0@lo:104: 00010000:00010000:0.0:1788482930.075422:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075477:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482930.075484:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:10310:x1875360098605184:12345-0@lo:104: Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.075492:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482930.075510:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788482930.075516:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098605312:12345-0@lo:104: 00010000:00010000:0.0:1788482930.075523:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075567:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788482930.075572:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098605312:12345-0@lo:104: Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.075578:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788482930.075608:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788482930.075614:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075623:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030000 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482930.075627:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075636:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482930.075644:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482930.075649:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482930.075682:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075689:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482930.075723:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075730:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0030000/0x1d7ea3d89ea1a514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a51b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075745:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482930.075749:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075754:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482930.075757:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075771:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482930.075778:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482930.075784:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482930.075800:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075805:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482930.075810:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075816:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1a4ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075826:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.075827:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.075829:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.075848:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.075857:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 23 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.075866:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605696:0@lo:104: 00000100:00100000:0.0:1788482930.075901:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.075925:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098605696 00000100:00100000:0.0:1788482930.075934:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098605696 00000100:00100000:0.0:1788482930.075954:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788482930.075959:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098605696:12345-0@lo:104: 00010000:00010000:0.0:1788482930.075967:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076003:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482930.076008:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098605696:12345-0@lo:104: Request processed in 49us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.076015:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788482930.076046:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076055:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.076063:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605824:0@lo:104: 00000100:00100000:0.0:1788482930.076090:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.076149:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788482930.076159:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098605824 00000100:00100000:0.0:1788482930.076163:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098605824 00000100:00100000:0.0:1788482930.076184:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788482930.076189:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd90c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098605824:12345-0@lo:104: 00010000:00010000:0.0:1788482930.076197:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076228:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788482930.076234:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd90c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098605824:12345-0@lo:104: Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.076249:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788482930.076289:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788482930.076294:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076300:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482930.076304:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076310:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482930.076317:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482930.076323:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482930.076340:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076345:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482930.076361:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076368:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3600/0x1d7ea3d89ea1a4ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4d5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076379:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482930.076382:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076399:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482930.076403:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076409:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482930.076416:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482930.076421:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482930.076436:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076443:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482930.076449:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076455:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a4a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a4ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076465:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.076468:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.076470:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482930.076485:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098605952:0@lo:103: 00000100:00100000:0.0:1788482930.076517:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.076554:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482930.076560:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098606080:0@lo:103: 00000100:00100000:0.0:1788482930.076594:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482930.076635:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076645:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.076653:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606208:0@lo:104: 00000100:00100000:0.0:1788482930.076674:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.076694:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606208 00000100:00100000:0.0:1788482930.076698:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606208 00000100:00100000:0.0:1788482930.076722:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788482930.076729:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098606208:12345-0@lo:104: 00010000:00010000:0.0:1788482930.076737:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076766:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482930.076771:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098606208:12345-0@lo:104: Request processed in 44us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.076778:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788482930.076792:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482930.076795:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076802:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482930.076805:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076812:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482930.076824:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482930.076830:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482930.076843:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076848:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482930.076853:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076860:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2e00/0x1d7ea3d89ea1a488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a48f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076870:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.076871:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.076872:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.076899:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.076907:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 23 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.076916:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606464:0@lo:104: 00000100:00100000:0.0:1788482930.076936:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.076953:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606464 00000100:00100000:0.0:1788482930.076956:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606464 00000100:00100000:0.0:1788482930.076974:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788482930.076980:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098606464:12345-0@lo:104: 00010000:00010000:0.0:1788482930.076996:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.077026:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482930.077032:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098606464:12345-0@lo:104: Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.077039:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788482930.077055:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482930.077059:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.077065:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482930.077068:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.077075:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482930.077082:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482930.077087:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482930.077127:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.077134:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482930.077138:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.077145:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1529400/0x1d7ea3d89ea1a47a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a481 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.078641:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.078659:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482930.078674:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606720:0@lo:104: 00000100:00100000:1.0:1788482930.078748:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482930.078807:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.078816:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 23 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482930.078825:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606848:0@lo:104: 00000100:00100000:1.0:1788482930.078846:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482930.078872:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.078880:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482930.078887:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606976:0@lo:104: 00000100:00100000:1.0:1788482930.078906:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482930.078936:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606720 00000100:00100000:1.0:1788482930.078943:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606720 00000100:00100000:1.0:1788482930.078981:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606848 00000100:00100000:1.0:1788482930.078984:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606848 00000100:00100000:1.0:1788482930.078994:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606976 00000100:00100000:1.0:1788482930.078996:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606976 00000100:00100000:1.0:1788482930.079008:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482930.079016:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:10310:x1875360098606720:12345-0@lo:104: 00010000:00010000:1.0:1788482930.079029:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.079071:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788482930.079078:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:10310:x1875360098606720:12345-0@lo:104: Request processed in 63us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.079122:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482930.079141:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482930.079148:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:10310:x1875360098606848:12345-0@lo:104: 00010000:00010000:1.0:1788482930.079156:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.079183:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788482930.079188:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:10310:x1875360098606848:12345-0@lo:104: Request processed in 42us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.079193:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482930.079204:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788482930.079210:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098606976:12345-0@lo:104: 00010000:00010000:1.0:1788482930.079217:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.079240:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788482930.079246:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10310:x1875360098606976:12345-0@lo:104: Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.079251:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788482930.079270:0:10310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c39709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482930.079301:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605184:0@lo:104: 00000100:00100000:1.0:1788482930.079313:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605312:0@lo:104: 00000100:00100000:1.0:1788482930.079322:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605696:0@lo:104: 00000100:00100000:1.0:1788482930.079332:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605824:0@lo:104: 00000100:00100000:1.0:1788482930.079342:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606208:0@lo:104: 00000100:00100000:1.0:1788482930.079362:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606464:0@lo:104: 00000100:00100000:1.0:1788482930.079370:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606720:0@lo:104: 00000100:00100000:1.0:1788482930.079377:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606848:0@lo:104: 00000100:00100000:1.0:1788482930.079383:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098606976:0@lo:104: 00010000:00010000:3.0:1788482930.083844:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788482930.083859:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.083871:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788482930.083876:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.083887:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482930.083895:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482930.083901:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482930.083953:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.083959:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482930.084009:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788482930.084018:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.084022:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.084046:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1a46c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a473 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.084049:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482930.084058:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.084075:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482930.084083:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.084085:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1788482930.084089:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482930.084146:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.084156:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.084158:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482930.084169:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc1480c20) 00010000:00010000:0.0:1788482930.084172:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482930.084174:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.084188:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a42d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a434 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.084209:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.084211:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.084215:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482930.084219:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788482930.084223:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482930.084233:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482930.084256:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.084262:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482930.084268:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.084274:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1529000/0x1d7ea3d89ea1a403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a40a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.084293:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482930.084296:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482930.084299:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482930.084339:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098605440:0@lo:103: 00000100:00100000:1.0:1788482930.084474:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098607104:0@lo:103: 00000100:00100000:1.0:1788482930.084523:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482930.084584:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482930.084591:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098607232:0@lo:103: 00000100:00100000:2.0:1788482930.084616:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098605952 00000100:00100000:1.0:1788482930.084617:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482930.084641:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098605952 00010000:00010000:2.0:1788482930.084691:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 24 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482930.084728:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606080 00000100:00100000:2.0:1788482930.084732:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606080 00010000:00010000:2.0:1788482930.084745:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 25 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482930.084757:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098607104 00000100:00100000:2.0:1788482930.084769:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098607104 00010000:00010000:2.0:1788482930.084784:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 26 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482930.084797:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098607232 00000100:00100000:2.0:1788482930.084800:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098607232 00010000:00010000:2.0:1788482930.084810:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 27 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482930.084823:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788482930.084832:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+27:3621:x1875360098605952:12345-0@lo:103: 00010000:00010000:2.0:1788482930.084849:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482930.084855:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 27 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.084867:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 27 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.084886:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0031200/0x1d7ea3d89ea1a4d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ce expref: 27 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.084904:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482930.084977:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+26:3621:x1875360098605952:12345-0@lo:103: Request processed in 145us (8458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482930.084985:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788482930.085045:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098605952:0@lo:103: 00000100:00100000:2.0:1788482930.085057:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482930.085069:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:3621:x1875360098606080:12345-0@lo:103: 00010000:00010000:2.0:1788482930.085080:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482930.085084:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 25 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085146:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 25 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085160:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a4ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4a4 expref: 25 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085172:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482930.085210:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098606080:12345-0@lo:103: Request processed in 145us (8615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482930.085217:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482930.085231:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482930.085239:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:3621:x1875360098607104:12345-0@lo:103: 00010000:00010000:2.0:1788482930.085247:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482930.085251:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085259:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085270:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a46c expref: 23 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085280:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482930.085306:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:3621:x1875360098607104:12345-0@lo:103: Request processed in 67us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482930.085313:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482930.085330:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482930.085340:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3621:x1875360098607232:12345-0@lo:103: 00010000:00010000:2.0:1788482930.085355:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482930.085360:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 21 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085368:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 21 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085378:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1529c00/0x1d7ea3d89ea1a434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a42d expref: 21 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482930.085388:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482930.085642:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3621:x1875360098607232:12345-0@lo:103: Request processed in 304us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482930.085649:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482930.085837:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098607232:0@lo:103: 00000100:00100000:2.0:1788482930.085854:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098607104:0@lo:103: 00000100:00100000:2.0:1788482930.085865:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098606080:0@lo:103: 00010000:00010000:0.0:1788482930.086184:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482930.086215:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098605568:0@lo:103: 00000100:00100000:0.0:1788482930.086265:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.086394:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098606592:0@lo:103: 00000100:00100000:0.0:1788482930.086418:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482930.093338:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482930.093397:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098605568 00000100:00100000:1.0:1788482930.093411:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098605568 00010000:00010000:1.0:1788482930.093469:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 20 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482930.093528:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606592 00000100:00100000:1.0:1788482930.093543:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606592 00010000:00010000:1.0:1788482930.093560:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 21 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482930.093577:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482930.093588:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3620:x1875360098605568:12345-0@lo:103: 00010000:00010000:1.0:1788482930.093608:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482930.093614:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 21 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.093627:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 21 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.093671:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1a4f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a4ea expref: 21 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.093693:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482930.093790:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3620:x1875360098605568:12345-0@lo:103: Request processed in 203us (7525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.093797:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482930.093818:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482930.093825:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:3620:x1875360098606592:12345-0@lo:103: 00010000:00010000:1.0:1788482930.093834:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482930.093838:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 19 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.093847:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 19 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.093858:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a47a expref: 19 pid: 6487 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.093868:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482930.093891:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3620:x1875360098606592:12345-0@lo:103: Request processed in 67us (7473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.093898:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482930.093965:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098604928:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788482930.094048:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098605568:0@lo:103: 00000100:00100000:0.0:1788482930.094059:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098606592:0@lo:103: 00000100:00100000:3.0:1788482930.095868:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098606336:0@lo:103: 00000100:00100000:3.0:1788482930.095972:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482930.101243:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098607360:0@lo:103: 00000100:00100000:3.0:1788482930.101328:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482930.101383:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098605440 00000100:00100000:0.0:1788482930.101394:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098605440 00010000:00010000:0.0:1788482930.101444:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 18 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.101491:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098606336 00000100:00100000:0.0:1788482930.101495:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098606336 00010000:00010000:0.0:1788482930.101509:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 19 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.101525:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788482930.101544:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:3619:x1875360098605440:12345-0@lo:103: 00010000:00010000:0.0:1788482930.101562:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482930.101569:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 19 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.101581:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 19 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.101604:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a51b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a514 expref: 19 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.101622:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482930.101677:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3619:x1875360098605440:12345-0@lo:103: Request processed in 142us (8352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.101686:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482930.101805:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482930.101816:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:3619:x1875360098606336:12345-0@lo:103: 00010000:00010000:1.0:1788482930.101826:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482930.101838:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 18 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.101846:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 18 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.101857:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a48f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a488 expref: 18 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.101869:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482930.101900:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:3619:x1875360098606336:12345-0@lo:103: Request processed in 87us (5929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.101906:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788482930.106306:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482930.106452:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020160 00000100:00100000:0.0:1788482930.106463:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020160 00010000:00010000:0.0:1788482930.106518:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 10 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482930.106569:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:0.0:1788482930.106582:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+10:2393:x1875360087020160:12345-192.168.206.54@tcp:103: 00010000:00010000:0.0:1788482930.106603:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482930.106611:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 10 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.106629:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 10 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.106655:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1a530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0e0 expref: 10 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.106677:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482930.106750:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+9:2393:x1875360087020160:12345-192.168.206.54@tcp:103: Request processed in 170us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.106758:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:1.0:1788482930.107060:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1875360098605056:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788482930.107158:0:10310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482930.107443:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482930.107471:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098607360 00000100:00100000:3.0:1788482930.107477:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098607360 00010000:00010000:3.0:1788482930.107506:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 16 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482930.107531:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020288 00000100:00100000:3.0:1788482930.107546:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020288 00010000:00010000:3.0:1788482930.107560:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 9 pid: 6488 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482930.107576:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788482930.107583:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:3619:x1875360098607360:12345-0@lo:103: 00010000:00010000:3.0:1788482930.107595:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482930.107600:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 16 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107609:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 16 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107623:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1528000/0x1d7ea3d89ea1a40a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a403 expref: 16 pid: 6488 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107636:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482930.107682:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:3619:x1875360098607360:12345-0@lo:103: Request processed in 99us (6355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482930.107688:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788482930.107724:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:3.0:1788482930.107731:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+9:2392:x1875360087020288:12345-192.168.206.54@tcp:103: 00010000:00010000:3.0:1788482930.107739:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482930.107743:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 9 pid: 6488 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107752:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 9 pid: 6488 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107763:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e0d9 expref: 9 pid: 6488 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107774:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107782:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107797:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107805:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107811:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107818:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107823:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788482930.107833:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107842:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107853:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482930.107862:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482930.107893:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+8:2392:x1875360087020288:12345-192.168.206.54@tcp:103: Request processed in 162us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482930.107899:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:3.0:1788482930.108016:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098607360:0@lo:103: 00000100:00100000:3.0:1788482930.108042:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098605440:0@lo:103: 00000100:00100000:3.0:1788482930.108051:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098606336:0@lo:103: 00010000:00010000:1.0:1788482930.108850:0:10310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.108863:0:10310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482930.108870:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a56f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482930.809368:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482930.829873:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482930.829933:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482930.829974:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482930.830009:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482930.830042:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482930.830131:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020544 00000100:00100000:1.0:1788482930.830147:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020544 00000100:00100000:1.0:1788482930.830233:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020672 00000100:00100000:1.0:1788482930.830237:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020672 00000100:00100000:1.0:1788482930.830264:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:1.0:1788482930.830406:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087020544:12345-192.168.206.54@tcp:400: 00000100:00100000:1.0:1788482930.830701:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087020544:12345-192.168.206.54@tcp:400: Request processed in 298us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.830711:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:1.0:1788482930.830733:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:1.0:1788482930.830741:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020672:12345-192.168.206.54@tcp:400: 00000100:00100000:1.0:1788482930.830769:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020672:12345-192.168.206.54@tcp:400: Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.830775:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00080000:1.0:1788482930.830797:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788482930.830802:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482930.830973:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020800 00000100:00100000:3.0:1788482930.830981:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020800 00000100:00100000:3.0:1788482930.831030:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020928 00000100:00100000:3.0:1788482930.831034:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020928 00000100:00100000:3.0:1788482930.831054:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:3.0:1788482930.831061:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020800:12345-192.168.206.54@tcp:400: 00000100:00100000:3.0:1788482930.831124:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020800:12345-192.168.206.54@tcp:400: Request processed in 35us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482930.831131:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:3.0:1788482930.831145:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788482930.831152:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020928:12345-192.168.206.54@tcp:400: 00000100:00100000:3.0:1788482930.831191:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087020928:12345-192.168.206.54@tcp:400: Request processed in 40us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482930.831212:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:0.0:1788482930.831665:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087020416 00000100:00100000:0.0:1788482930.831672:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087020416 00000100:00100000:0.0:1788482930.831712:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 200 00000100:00100000:0.0:1788482930.831720:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+8:2390:x1875360087020416:12345-192.168.206.54@tcp:400: 00000100:00100000:0.0:1788482930.831763:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+8:2390:x1875360087020416:12345-192.168.206.54@tcp:400: Request processed in 44us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482930.831770:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 200 00000100:00080000:1.0:1788482930.831888:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482930.831894:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482930.936847:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098607488:0@lo:41: 00000100:00100000:0.0:1788482930.936949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482930.937396:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098607488 00000100:00100000:3.0:1788482930.937411:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098607488 00000100:00100000:3.0:1788482930.937482:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788482930.937494:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098607488:12345-0@lo:41: 00000004:00000024:3.0:1788482930.937559:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482930.943723:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098607488:12345-0@lo:41: Request processed in 6216us (6758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482930.943743:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788482930.945817:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098607488:0@lo:41: 10000000:01000000:3.0:1788482931.641998:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788482931.642010:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68c1c41000 from 48 10000000:01000000:3.0:1788482931.642017:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788482931.642786:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.642805:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.642819:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482931.642850:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098607616:0@lo:101: 00000100:00100000:3.0:1788482931.642944:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.643217:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c97259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.653084:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098607616 00000100:00100000:0.0:1788482931.653135:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098607616 00000100:00100000:0.0:1788482931.653246:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788482931.653258:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+15:6491:x1875360098607616:12345-0@lo:101: 00010000:00010000:0.0:1788482931.653289:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482931.653316:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0030000/0x1d7ea3d89ea1a57d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a576 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.653352:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030000/0x1d7ea3d89ea1a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a576 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.653365:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0030000/0x1d7ea3d89ea1a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a576 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.653375:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030000, rc 0) 00000100:00100000:0.0:1788482931.653477:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098607616:12345-0@lo:101: Request processed in 221us (10532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.653484:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788482931.654012:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098607616:0@lo:101: 00010000:00010000:1.0:1788482931.654039:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.654051:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.654196:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098607744:0@lo:501: 00000100:00100000:1.0:1788482931.654247:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.654324:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.657148:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098607744 00000100:00100000:3.0:1788482931.657180:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098607744 00000100:00100000:3.0:1788482931.657317:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788482931.657331:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098607744:12345-0@lo:501: 00000100:00100000:3.0:1788482931.659221:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098607744:12345-0@lo:501: Request processed in 1882us (4964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.659238:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788482931.660018:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098607744:0@lo:501: 00000100:00100000:0.0:1788482931.660156:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098607872:0@lo:503: 00000100:00100000:0.0:1788482931.660278:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.660332:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c39700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.660985:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098607872 00000100:00100000:2.0:1788482931.660999:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098607872 00000100:00100000:2.0:1788482931.661068:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788482931.661078:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098607872:12345-0@lo:503: 00000100:00100000:2.0:1788482931.661307:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098607872:12345-0@lo:503: Request processed in 230us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.661314:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788482931.662161:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098607872:0@lo:503: 00000100:00100000:0.0:1788482931.668086:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10327:1875360098608000:0@lo:502: 00000100:00100000:0.0:1788482931.668283:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.668333:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c39709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482931.668520:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608000 00000100:00100000:1.0:1788482931.668538:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608000 00000100:00100000:1.0:1788482931.668594:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788482931.668604:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:10327:x1875360098608000:12345-0@lo:502: 00000100:00100000:1.0:1788482931.668767:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:10327:x1875360098608000:12345-0@lo:502: Request processed in 164us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.668775:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788482931.669315:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10327:1875360098608000:0@lo:502: 00000100:00100000:0.0:1788482931.669381:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10327:1875360098608128:0@lo:502: 00000100:00100000:0.0:1788482931.669433:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.669472:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c39709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.669797:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608128 00000100:00100000:3.0:1788482931.669804:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608128 00000100:00100000:3.0:1788482931.669851:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788482931.669859:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:10327:x1875360098608128:12345-0@lo:502: 00000100:00100000:3.0:1788482931.669982:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:10327:x1875360098608128:12345-0@lo:502: Request processed in 122us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.669989:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788482931.670090:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10327:1875360098608128:0@lo:502: 00000040:00080000:2.0:1788482931.678491:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788482931.678815:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788482931.678844:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788482931.678859:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.678872:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482931.678883:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788482931.678886:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788482931.678889:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788482931.678944:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.678952:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.678965:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.678994:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608256:0@lo:101: 00000100:00100000:1.0:1788482931.679135:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.679210:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.681287:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608256 00000100:00100000:2.0:1788482931.681309:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608256 00000100:00100000:2.0:1788482931.681418:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788482931.681430:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+16:6491:x1875360098608256:12345-0@lo:101: 00010000:00010000:2.0:1788482931.681451:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482931.681475:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0e00/0x1d7ea3d89ea1a58b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a584 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.681510:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0e00/0x1d7ea3d89ea1a58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a584 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.681522:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0e00/0x1d7ea3d89ea1a58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a584 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.681543:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0e00, rc 0) 00000100:00100000:2.0:1788482931.681652:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098608256:12345-0@lo:101: Request processed in 224us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.681659:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788482931.682520:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608256:0@lo:101: 00010000:00010000:1.0:1788482931.682558:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.682571:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.682678:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608384:0@lo:501: 00000100:00100000:1.0:1788482931.682732:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.682776:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.682837:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608384 00000100:00100000:0.0:1788482931.682845:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608384 00000100:00100000:0.0:1788482931.682893:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788482931.682902:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098608384:12345-0@lo:501: 00000100:00100000:0.0:1788482931.683071:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098608384:12345-0@lo:501: Request processed in 170us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.683079:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788482931.683559:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608384:0@lo:501: 00000100:00100000:1.0:1788482931.683602:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608512:0@lo:503: 00000100:00100000:1.0:1788482931.683675:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.683708:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.684804:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608512 00000100:00100000:0.0:1788482931.684819:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608512 00000100:00100000:0.0:1788482931.684949:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788482931.684961:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098608512:12345-0@lo:503: 00000100:00100000:0.0:1788482931.685225:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098608512:12345-0@lo:503: Request processed in 265us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.685234:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788482931.685366:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608512:0@lo:503: 00000100:00100000:2.0:1788482931.686141:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10328:1875360098608640:0@lo:502: 00000100:00100000:2.0:1788482931.686222:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.686841:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482931.686922:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608640 00000100:00100000:1.0:1788482931.686931:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608640 00000100:00100000:1.0:1788482931.686979:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788482931.686989:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:10328:x1875360098608640:12345-0@lo:502: 00000100:00100000:1.0:1788482931.687191:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:10328:x1875360098608640:12345-0@lo:502: Request processed in 203us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.687210:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788482931.687497:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10328:1875360098608640:0@lo:502: 00000020:01000000:2.0:1788482931.687553:0:10328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482931.687566:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482931.687569:0:10328:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788482931.687574:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788482931.687612:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10328:1875360098608768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482931.687672:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.687706:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482931.687957:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608768 00000100:00100000:1.0:1788482931.687964:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608768 00000100:00100000:1.0:1788482931.687996:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788482931.688005:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:10328:x1875360098608768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.688168:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:10328:x1875360098608768:12345-0@lo:502:llog_process_th.0 Request processed in 164us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.688182:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788482931.688553:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10328:1875360098608768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482931.688585:0:10328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482931.688594:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482931.688596:0:10328:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788482931.688600:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788482931.688977:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788482931.689003:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788482931.689016:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.689029:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482931.689041:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788482931.689045:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69e00f6800 from 48 10000000:01000000:1.0:1788482931.689060:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482931.689121:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.689131:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.689141:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.689165:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.689228:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.689277:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.689940:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098608896 00000100:00100000:0.0:1788482931.689953:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098608896 00000100:00100000:0.0:1788482931.690009:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788482931.690020:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+17:6491:x1875360098608896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482931.690037:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482931.690061:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a592 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.690093:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a592 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.690120:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a592 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.690130:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030200, rc 0) 00000100:00100000:1.0:1788482931.690310:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098608896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482931.690328:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.690362:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.690446:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.691730:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.691787:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.691853:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609024 00000100:00100000:3.0:1788482931.691862:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609024 00000100:00100000:3.0:1788482931.691970:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788482931.691983:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098609024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.692589:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098609024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 607us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.692600:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788482931.692762:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098608896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2743us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.692770:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788482931.692847:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.692970:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.693036:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.693211:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482931.693392:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609152 00000100:00100000:1.0:1788482931.693399:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609152 00000100:00100000:1.0:1788482931.693486:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788482931.693495:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098609152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.693825:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098609152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 330us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.693833:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788482931.694029:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.695423:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10329:1875360098609280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.695588:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.695639:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.695721:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609280 00000100:00100000:0.0:1788482931.695731:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609280 00000100:00100000:0.0:1788482931.695792:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788482931.695803:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:10329:x1875360098609280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482931.695961:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:10329:x1875360098609280:12345-0@lo:502:llog_process_th.0 Request processed in 159us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.695969:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788482931.696345:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10329:1875360098609280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.696409:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10329:1875360098609408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.696452:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.696488:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.696551:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609408 00000100:00100000:3.0:1788482931.696557:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609408 00000100:00100000:3.0:1788482931.696755:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788482931.696766:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:10329:x1875360098609408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482931.696877:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:10329:x1875360098609408:12345-0@lo:502:llog_process_th.0 Request processed in 113us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.696884:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788482931.696971:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10329:1875360098609408:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788482931.696992:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788482931.697349:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788482931.697374:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788482931.697387:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.697398:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482931.697409:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788482931.697412:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788482931.697415:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788482931.697450:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.697458:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.697467:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482931.697487:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.697524:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.697564:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2799600 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.697700:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609536 00000100:00100000:0.0:1788482931.697707:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609536 00000100:00100000:0.0:1788482931.697744:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788482931.697753:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+18:6491:x1875360098609536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482931.697775:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482931.697790:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a5a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a5a0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.697816:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5a0 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.697826:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5a0 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.697835:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030800, rc 0) 00000100:00100000:0.0:1788482931.697930:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098609536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.697937:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788482931.698625:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482931.698649:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.698662:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482931.698751:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.698869:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.698913:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.698963:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609664 00000100:00100000:3.0:1788482931.698970:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609664 00000100:00100000:3.0:1788482931.699015:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788482931.699025:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098609664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.699914:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098609664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 886us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.699926:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788482931.700035:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.700792:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.700874:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.700971:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.701020:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609792 00000100:00100000:3.0:1788482931.701030:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609792 00000100:00100000:3.0:1788482931.701678:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788482931.701692:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098609792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.701855:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098609792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.701864:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788482931.702308:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098609792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.703921:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10330:1875360098609920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.704033:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.704752:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.704799:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098609920 00000100:00100000:3.0:1788482931.704809:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098609920 00000100:00100000:3.0:1788482931.704906:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788482931.704918:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:10330:x1875360098609920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482931.705147:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:10330:x1875360098609920:12345-0@lo:502:llog_process_th.0 Request processed in 230us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.705157:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788482931.705287:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10330:1875360098609920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482931.705328:0:10330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482931.705340:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482931.705343:0:10330:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788482931.705348:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788482931.705387:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10330:1875360098610048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482931.705433:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.705969:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482931.706835:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610048 00000100:00100000:1.0:1788482931.706853:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610048 00000100:00100000:1.0:1788482931.706927:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788482931.706937:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:10330:x1875360098610048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.707481:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:10330:x1875360098610048:12345-0@lo:502:llog_process_th.0 Request processed in 542us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.707492:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788482931.707686:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10330:1875360098610048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482931.707733:0:10330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482931.707742:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482931.707745:0:10330:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788482931.707750:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788482931.707953:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788482931.707983:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788482931.707995:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.708008:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482931.708020:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788482931.708023:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69c5051000 from 48 10000000:01000000:1.0:1788482931.708027:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482931.708078:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.708086:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.708134:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.708159:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.708428:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.708475:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.708600:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610176 00000100:00100000:2.0:1788482931.708608:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610176 00000100:00100000:2.0:1788482931.708647:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788482931.708656:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:6491:x1875360098610176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482931.708672:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482931.708689:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a5ae expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.708719:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ae expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.708731:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ae expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.708754:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0800, rc 0) 00000100:00100000:2.0:1788482931.708807:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098610176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.708814:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788482931.708891:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482931.708907:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.708916:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.708987:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.709017:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.709436:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610304 00000100:00100000:2.0:1788482931.709443:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610304 00000100:00100000:2.0:1788482931.709472:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788482931.709479:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098610304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.709603:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.709791:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098610304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.709799:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788482931.709870:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.709910:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.709965:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.709999:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.710038:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610432 00000100:00100000:2.0:1788482931.710044:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610432 00000100:00100000:2.0:1788482931.710064:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788482931.710070:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098610432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.710267:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098610432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.710275:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788482931.710360:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.710908:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10331:1875360098610560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.710964:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.711039:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.712471:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610560 00000100:00100000:0.0:1788482931.712487:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610560 00000100:00100000:0.0:1788482931.712780:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788482931.712792:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:10331:x1875360098610560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482931.713007:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:10331:x1875360098610560:12345-0@lo:502:llog_process_th.0 Request processed in 217us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.713016:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788482931.713478:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10331:1875360098610560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482931.713802:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10331:1875360098610688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482931.713857:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.713889:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c39700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.714861:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610688 00000100:00100000:2.0:1788482931.714876:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610688 00000100:00100000:2.0:1788482931.714939:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788482931.714950:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:10331:x1875360098610688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482931.715151:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:10331:x1875360098610688:12345-0@lo:502:llog_process_th.0 Request processed in 201us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.715159:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788482931.715228:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10331:1875360098610688:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788482931.715284:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788482931.715398:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788482931.715420:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788482931.715433:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.715445:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482931.715456:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788482931.715459:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788482931.715463:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788482931.715498:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.715507:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.715517:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482931.715551:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.715592:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.715629:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.715717:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610816 00000100:00100000:0.0:1788482931.715728:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610816 00000100:00100000:0.0:1788482931.715767:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788482931.715775:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098610816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482931.715786:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482931.715801:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a5c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a5bc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.715825:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5bc expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.715837:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5bc expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.715847:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030e00, rc 0) 00000100:00100000:0.0:1788482931.715893:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098610816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.715899:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788482931.716493:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482931.716697:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.716710:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.716808:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.716852:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.716959:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.717039:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098610944 00000100:00100000:3.0:1788482931.717045:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098610944 00000100:00100000:3.0:1788482931.717642:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788482931.717654:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098610944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.717832:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098610944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.717840:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788482931.717916:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098610944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.717961:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.718015:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.718967:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.719044:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611072 00000100:00100000:0.0:1788482931.719203:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611072 00000100:00100000:0.0:1788482931.719252:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788482931.719271:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098611072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482931.719455:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098611072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.719463:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788482931.719663:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.721696:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10332:1875360098611200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.721795:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.721885:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.721925:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611200 00000100:00100000:0.0:1788482931.721933:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611200 00000100:00100000:0.0:1788482931.722440:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788482931.722454:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10332:x1875360098611200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482931.722704:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10332:x1875360098611200:12345-0@lo:502:llog_process_th.0 Request processed in 253us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.722713:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788482931.724072:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10332:1875360098611200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788482931.724145:0:10332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482931.724161:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482931.724164:0:10332:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788482931.724180:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788482931.724229:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10332:1875360098611328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.724746:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.724837:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.724908:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611328 00000100:00100000:2.0:1788482931.724917:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611328 00000100:00100000:2.0:1788482931.725016:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788482931.725030:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10332:x1875360098611328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482931.726816:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10332:x1875360098611328:12345-0@lo:502:llog_process_th.0 Request processed in 1777us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.726834:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788482931.728872:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10332:1875360098611328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482931.728936:0:10332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482931.728947:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482931.728950:0:10332:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788482931.728955:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788482931.729414:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788482931.729443:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788482931.729457:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.729471:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482931.729483:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788482931.729485:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69d20cc000 from 48 10000000:01000000:2.0:1788482931.729488:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788482931.729544:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.729552:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.729563:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482931.729590:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.729676:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.729724:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.729897:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611456 00000100:00100000:3.0:1788482931.729920:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611456 00000100:00100000:3.0:1788482931.729976:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788482931.729986:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098611456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482931.730001:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482931.730017:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76a00/0x1d7ea3d89ea1a5d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a5ca expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.730045:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76a00/0x1d7ea3d89ea1a5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ca expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.730068:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76a00/0x1d7ea3d89ea1a5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ca expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.730078:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76a00, rc 0) 00000100:00100000:3.0:1788482931.730144:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098611456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.730152:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788482931.730442:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482931.730459:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.730469:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482931.730558:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.730586:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.730676:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.730772:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611584 00000100:00100000:3.0:1788482931.730777:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611584 00000100:00100000:3.0:1788482931.730809:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788482931.730816:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098611584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.731013:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098611584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.731021:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788482931.731832:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482931.731966:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021056 00000100:00100000:2.0:1788482931.731974:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021056 00000100:00100000:2.0:1788482931.732032:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 233 00000100:00100000:2.0:1788482931.732042:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+8:6166:x1875360087021056:12345-192.168.206.54@tcp:101: 00010000:00010000:2.0:1788482931.732068:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482931.732091:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a5d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e150 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.732156:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e150 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.732167:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e150 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.732187:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0c00, rc 0) 00000100:00100000:2.0:1788482931.732259:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+9:6166:x1875360087021056:12345-192.168.206.54@tcp:101: Request processed in 218us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.732277:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 233 00000100:00100000:1.0:1788482931.733011:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.733443:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.733535:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.733581:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.733643:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611712 00000100:00100000:3.0:1788482931.733650:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611712 00000100:00100000:3.0:1788482931.733703:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788482931.733712:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098611712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.733851:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098611712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.733859:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788482931.734131:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098611712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482931.735697:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10333:1875360098611840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482931.735803:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.735854:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.735968:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611840 00000100:00100000:3.0:1788482931.735977:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611840 00000100:00100000:3.0:1788482931.736031:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788482931.736042:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10333:x1875360098611840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482931.736255:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10333:x1875360098611840:12345-0@lo:502:llog_process_th.0 Request processed in 214us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.736276:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788482931.736785:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10333:1875360098611840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482931.736867:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10333:1875360098611968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482931.736914:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.736953:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788482931.737001:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098611968 00000100:00100000:3.0:1788482931.737008:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098611968 00000100:00100000:3.0:1788482931.737054:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788482931.737063:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10333:x1875360098611968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482931.737735:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10333:x1875360098611968:12345-0@lo:502:llog_process_th.0 Request processed in 670us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.737746:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788482931.737971:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10333:1875360098611968:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788482931.738002:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788482931.738291:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788482931.738444:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788482931.738459:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.738473:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482931.738485:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788482931.738488:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788482931.738491:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788482931.738539:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.738548:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482931.738559:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482931.738596:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788482931.739017:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.739543:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612096 00000100:00100000:3.0:1788482931.739555:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612096 00000100:00100000:0.0:1788482931.739814:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482931.741067:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482931.741808:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021184 00000100:00100000:2.0:1788482931.741822:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021184 00000100:00100000:3.0:1788482931.741906:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788482931.741928:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098612096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482931.741952:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482931.741977:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1a5e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a5df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.742015:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1a5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5df expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.742048:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1a5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5df expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.742059:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76400, rc 0) 00000100:00100000:3.0:1788482931.742201:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098612096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (3177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.742296:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482931.744246:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.744272:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482931.744434:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.744523:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.744577:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.747691:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612224 00000100:00100000:0.0:1788482931.747709:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612224 00000100:00100000:0.0:1788482931.747769:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788482931.747780:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098612224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482931.747996:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098612224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (3473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.748004:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788482931.748542:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 239 00000100:00100000:2.0:1788482931.748558:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+9:6166:x1875360087021184:12345-192.168.206.54@tcp:501: 00000100:00100000:2.0:1788482931.748671:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+9:6166:x1875360087021184:12345-192.168.206.54@tcp:501: Request processed in 119us (7611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.748677:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 239 00000100:00100000:1.0:1788482931.748828:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.748886:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482931.748956:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.748995:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482931.749042:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612352 00000100:00100000:2.0:1788482931.749057:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612352 00000100:00100000:2.0:1788482931.749081:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788482931.749086:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098612352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.749219:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098612352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.749225:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788482931.749438:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.751724:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788482931.752865:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10334:1875360098612480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482931.752968:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.753074:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.753769:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482931.753850:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612480 00000100:00100000:1.0:1788482931.753859:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612480 00000100:00100000:1.0:1788482931.753929:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021312 00000100:00100000:1.0:1788482931.753933:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021312 00000100:00100000:1.0:1788482931.753952:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788482931.753962:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10334:x1875360098612480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482931.754504:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 242 00000100:00100000:3.0:1788482931.754518:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+9:6166:x1875360087021312:12345-192.168.206.54@tcp:503: 00000100:00100000:3.0:1788482931.754749:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+9:6166:x1875360087021312:12345-192.168.206.54@tcp:503: Request processed in 233us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.754759:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 242 00000100:00100000:1.0:1788482931.754959:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10334:x1875360098612480:12345-0@lo:502:llog_process_th.0 Request processed in 998us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.754981:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788482931.755699:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10334:1875360098612480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482931.755744:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482931.755755:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482931.755757:0:10334:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788482931.755763:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788482931.755806:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10334:1875360098612608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482931.755866:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.755917:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.755966:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612608 00000100:00100000:0.0:1788482931.755974:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612608 00000100:00100000:0.0:1788482931.756028:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788482931.756036:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10334:x1875360098612608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482931.756815:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10334:x1875360098612608:12345-0@lo:502:llog_process_th.0 Request processed in 775us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.756826:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788482931.756943:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10334:1875360098612608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482931.756977:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482931.756985:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482931.756987:0:10334:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788482931.756991:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788482931.757760:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1788482931.757787:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788482931.757804:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.757817:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482931.757838:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788482931.757842:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a69f45ecd28 from 1 10000000:01000000:2.0:1788482931.757845:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788482931.757886:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.757893:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482931.757903:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482931.757926:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.757983:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.758029:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c36ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1788482931.758441:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612736 00000100:00100000:1.0:1788482931.758564:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612736 00000100:00100000:1.0:1788482931.758734:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788482931.758747:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098612736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482931.758766:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482931.758782:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1a5f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a5ed expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.758809:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1a5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ed expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.758820:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1a5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ed expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.758830:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a400, rc 0) 00000100:00100000:1.0:1788482931.758893:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098612736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.758900:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788482931.759557:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482931.759583:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5f4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.759593:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5f4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482931.759994:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482931.760135:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.760234:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482931.760473:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612864 00000100:00100000:0.0:1788482931.760482:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612864 00000100:00100000:0.0:1788482931.760547:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788482931.760558:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098612864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482931.760846:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098612864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (710us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788482931.760855:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788482931.760944:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098612864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788482931.760987:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788482931.760997:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5f4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482931.761008:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5f4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482931.762753:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482931.762848:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021440 00000100:00100000:2.0:1788482931.762858:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021440 00000100:00100000:2.0:1788482931.762924:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 246 00000100:00100000:2.0:1788482931.762936:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+9:6649:x1875360087021440:12345-192.168.206.54@tcp:502: 00000100:00100000:2.0:1788482931.763152:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+9:6649:x1875360087021440:12345-192.168.206.54@tcp:502: Request processed in 217us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.763160:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 246 00000100:00100000:0.0:1788482931.766851:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482931.767052:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021568 00000100:00100000:3.0:1788482931.767066:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021568 00000100:00100000:3.0:1788482931.767196:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 247 00000100:00100000:3.0:1788482931.767209:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+9:6649:x1875360087021568:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788482931.767455:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+9:6649:x1875360087021568:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 246us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.767465:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 247 00000100:00100000:0.0:1788482931.773611:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482931.774039:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021696 00000100:00100000:1.0:1788482931.774054:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021696 00000100:00100000:1.0:1788482931.774184:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 248 00000100:00100000:1.0:1788482931.774196:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+9:6166:x1875360087021696:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482931.774218:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482931.774240:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1a5fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e157 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.774277:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1a5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e157 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.774664:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1a5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e157 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482931.774677:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8be00, rc 0) 00000100:00100000:1.0:1788482931.774750:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087021696:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 555us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482931.774758:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 248 00000100:00100000:1.0:1788482931.786408:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482931.786475:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021824 00000100:00100000:2.0:1788482931.786487:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021824 00000100:00100000:2.0:1788482931.786561:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 249 00000100:00100000:2.0:1788482931.786574:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087021824:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482931.786839:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087021824:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 267us (445us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788482931.786864:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 249 00010000:00010000:3.0:1788482931.846290:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482931.960748:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098613376:0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.960749:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098613120:0@lo:400:kworker.0 00000100:00100000:1.0:1788482931.960833:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098612992:0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.960906:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098613248:0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.960920:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.960970:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.960988:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098613632:0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.961012:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098613760:0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.961038:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.961047:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.961075:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098614272:0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.961084:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098614144:0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.961122:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.961175:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098613248 00000100:00100000:3.0:1788482931.961185:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098613248 00000100:00100000:3.0:1788482931.961237:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098613632 00000100:00100000:3.0:1788482931.961241:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098613632 00000100:00100000:3.0:1788482931.961281:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788482931.961293:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098613248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.961370:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098613248:12345-0@lo:400:kworker.0 Request processed in 66us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.961379:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788482931.961407:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788482931.961420:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098613632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.961450:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098613632:12345-0@lo:400:kworker.0 Request processed in 37us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.961455:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788482931.961475:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098613760 00000100:00100000:3.0:1788482931.961479:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098613760 00000100:00100000:3.0:1788482931.961519:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614272 00000100:00100000:3.0:1788482931.961522:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614272 00000100:00100000:3.0:1788482931.961555:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482931.961563:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098613760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.961597:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098613760:12345-0@lo:400:kworker.0 Request processed in 36us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.961615:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482931.961627:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788482931.961634:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098614272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.961739:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788482931.961785:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd937100 x1875360098613632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482931.961802:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098613632:0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.961833:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098613120 00000100:00100000:2.0:1788482931.961837:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098613120 00000100:00100000:2.0:1788482931.961870:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788482931.961877:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098613120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.961919:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098613120:12345-0@lo:400:kworker.0 Request processed in 43us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.961926:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788482931.961947:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614144 00000100:00100000:2.0:1788482931.961951:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614144 00000100:00100000:2.0:1788482931.961970:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788482931.961977:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098614144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.962009:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098614144:12345-0@lo:400:kworker.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.962016:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788482931.962762:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098613120:0@lo:400:kworker.0 00010000:00080000:2.0:1788482931.962778:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd932a00 x1875360098614144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482931.962790:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098614144:0@lo:400:kworker.0 00000100:00080000:2.0:1788482931.962844:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788482931.962849:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482931.962854:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788482931.962899:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098613248:0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.962915:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098614272:12345-0@lo:400:kworker.0 Request processed in 1278us (1789us total) trans 0 rc 0/0 00010000:00080000:2.0:1788482931.962919:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd934380 x1875360098613760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482931.962932:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788482931.962935:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098613760:0@lo:400:kworker.0 00010000:00080000:2.0:1788482931.962954:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd933b80 x1875360098614272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482931.962963:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098614272:0@lo:400:kworker.0 00000100:00100000:0.0:1788482931.966345:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.966439:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098613888:0@lo:400:kworker.0 00000100:00100000:0.0:1788482931.966488:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.966534:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098614400:0@lo:400:kworker.0 00000100:00100000:0.0:1788482931.966559:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.966827:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098613888 00000100:00100000:0.0:1788482931.966839:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098613888 00000100:00100000:0.0:1788482931.966905:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614400 00000100:00100000:0.0:1788482931.966909:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614400 00000100:00100000:0.0:1788482931.966933:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788482931.966943:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098613888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482931.967008:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098613888:12345-0@lo:400:kworker.0 Request processed in 67us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.967016:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788482931.967035:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788482931.967041:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098614400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482931.967068:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098614400:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.967074:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788482931.967091:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482931.967126:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482931.967157:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd935c00 x1875360098613888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482931.967197:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098613888:0@lo:400:kworker.0 00010000:00080000:0.0:1788482931.967211:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755880 x1875360098614400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482931.967218:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098614400:0@lo:400:kworker.0 00000100:00100000:1.0:1788482931.968922:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482931.969084:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098613376 00000100:00100000:3.0:1788482931.969132:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098613376 00000100:00100000:3.0:1788482931.969209:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788482931.969221:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098613376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482931.969311:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098613376:12345-0@lo:400:kworker.0 Request processed in 93us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.969320:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788482931.969778:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098613376:0@lo:400:kworker.0 00000100:00100000:1.0:1788482931.974420:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098613504:0@lo:400:kworker.0 00000100:00100000:1.0:1788482931.974522:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.976547:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098614016:0@lo:400:kworker.0 00000100:00100000:1.0:1788482931.976636:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482931.976774:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098612992 00000100:00100000:2.0:1788482931.976785:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098612992 00000100:00100000:2.0:1788482931.976859:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098613504 00000100:00100000:2.0:1788482931.976863:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098613504 00000100:00100000:2.0:1788482931.976901:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788482931.976913:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098612992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.976984:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098612992:12345-0@lo:400:kworker.0 Request processed in 73us (8077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.976992:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788482931.977011:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788482931.977018:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098613504:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788482931.978451:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482931.978460:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098613504:12345-0@lo:400:kworker.0 Request processed in 1433us (3930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.978474:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788482931.978742:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098614528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482931.978789:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482931.978866:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098612992:0@lo:400:kworker.0 00000100:00100000:1.0:1788482931.978881:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098613504:0@lo:400:kworker.0 00000100:00100000:2.0:1788482931.978963:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614528 00000100:00100000:2.0:1788482931.978971:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614528 00000100:00100000:2.0:1788482931.979027:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482931.979061:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098614528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788482931.981283:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482931.981581:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098614528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2539us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482931.981594:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788482931.981769:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376b100 x1875360098614528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482931.981801:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098614528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482931.984327:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614016 00000100:00100000:3.0:1788482931.984350:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614016 00000100:00100000:3.0:1788482931.984792:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788482931.984805:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098614016:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788482931.985015:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482931.985077:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098614016:12345-0@lo:400:kworker.0 Request processed in 274us (8439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482931.985086:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788482931.988720:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098614016:0@lo:400:kworker.0 00000100:00100000:3.0:1788482932.472652:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482932.472689:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098614656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788482932.472813:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482932.472917:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614656 00000100:00100000:3.0:1788482932.472927:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614656 00000100:00100000:3.0:1788482932.473070:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788482932.473126:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098614656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788482932.473222:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482932.473278:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098614656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (468us total) trans 0 rc 0/0 00010000:00080000:0.0:1788482932.476088:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37f9500 x1875360098614656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482932.476161:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098614656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788482932.476485:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788482932.856609:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482933.498314:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098614784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788482933.498563:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482933.498672:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614784 00000100:00100000:3.0:1788482933.498684:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614784 00000100:00100000:3.0:1788482933.498744:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788482933.498757:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098614784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788482933.498803:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482933.498855:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098614784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482933.498862:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788482933.498926:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098614784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788482933.499349:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482933.499362:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098614912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788482933.499473:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482933.505133:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098615040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482933.505245:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482933.518921:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098614912 00000100:00100000:1.0:1788482933.518942:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098614912 00000100:00080000:1.0:1788482933.519007:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482933.519060:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098615040 00000100:00100000:1.0:1788482933.519064:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098615040 00000100:00080000:1.0:1788482933.519078:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482933.519126:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482933.519138:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098614912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788482933.519178:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482933.519294:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098614912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (19819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482933.519303:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788482933.519366:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb84380 x1875360098614912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482933.519397:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098614912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482933.519449:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788482933.519456:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098615040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482933.519467:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482933.519502:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098615040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (14258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482933.519509:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788482933.519552:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37f8380 x1875360098615040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482933.519568:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098615040:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788482933.585981:0:10371:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8db0a1d0 20000000:00000080:1.0:1788482933.586013:0:10371:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a68c3664800 uarg=0000000000000000 20000000:01000000:1.0:1788482933.586072:0:10371:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788482933.586081:0:10371:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788482933.586088:0:10371:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788482933.590896:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788482933.591137:0:10371:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788482933.598561:0:10371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788482933.598616:0:10371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788482933.598646:0:10371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788482933.598669:0:10371:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788482933.598696:0:10371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598720:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e2a00/0x1d7ea3d89ea1a29e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598728:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598736:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598743:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598753:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598761:0:10371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598819:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.598856:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 9 pid: 6486 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482933.598876:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615168:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788482933.599022:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.599031:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 23 pid: 6487 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482933.599041:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615296:0@lo:104: 00000100:00100000:1.0:1788482933.599130:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482933.599182:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.599190:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 23 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482933.599198:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615424:0@lo:104: 00000100:00100000:1.0:1788482933.599224:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482933.599249:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.599257:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 23 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482933.599266:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615552:0@lo:104: 00010000:00010000:1.0:1788482933.599293:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e2a00/0x1d7ea3d89ea1a29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482933.599308:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c29e2a00/0x1d7ea3d89ea1a29e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 23 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482933.599317:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615680:0@lo:104: 00000100:00100000:1.0:1788482933.599339:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482933.599616:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788482933.599651:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482933.599679:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482933.599688:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098615296 00000100:00100000:2.0:1788482933.599696:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098615296 00000100:00100000:2.0:1788482933.599749:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098615424 00000100:00100000:2.0:1788482933.599752:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098615424 00000100:00100000:2.0:1788482933.599764:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098615552 00000100:00100000:2.0:1788482933.599767:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098615552 00000100:00100000:2.0:1788482933.599775:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098615680 00000100:00100000:2.0:1788482933.599776:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098615680 00000100:00100000:2.0:1788482933.599791:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788482933.599800:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:10371:x1875360098615296:12345-0@lo:104: 00010000:00010000:2.0:1788482933.599816:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482933.599876:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482933.599882:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:10371:x1875360098615296:12345-0@lo:104: Request processed in 83us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482933.599898:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788482933.599918:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788482933.599924:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdcc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:10371:x1875360098615424:12345-0@lo:104: 00010000:00010000:2.0:1788482933.599933:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482933.599974:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788482933.599979:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdcc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:10371:x1875360098615424:12345-0@lo:104: Request processed in 55us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482933.599985:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788482933.600017:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788482933.600023:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:10371:x1875360098615552:12345-0@lo:104: 00010000:00010000:2.0:1788482933.600031:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482933.600058:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788482933.600063:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:10371:x1875360098615552:12345-0@lo:104: Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482933.600068:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788482933.600078:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788482933.600083:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10371:x1875360098615680:12345-0@lo:104: 00010000:00010000:2.0:1788482933.600090:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482933.600141:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788482933.600145:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:10371:x1875360098615680:12345-0@lo:104: Request processed in 62us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482933.600156:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788482933.600336:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615296:0@lo:104: 00000100:00100000:1.0:1788482933.600347:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615424:0@lo:104: 00000100:00100000:1.0:1788482933.600354:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615552:0@lo:104: 00000100:00100000:1.0:1788482933.600359:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615680:0@lo:104: 00010000:00010000:0.0:1788482933.600606:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788482933.600615:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600623:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482933.600627:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600646:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482933.600655:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482933.600669:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482933.600717:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600725:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482933.600749:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600756:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a41f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a426 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600771:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788482933.600774:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600779:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482933.600782:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600789:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482933.600795:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482933.600800:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482933.600812:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600817:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482933.600840:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600847:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a2f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a300 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600857:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788482933.600860:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600866:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482933.600868:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600874:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482933.600880:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482933.600885:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482933.600898:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600904:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482933.600909:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600916:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a2a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a2ac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600925:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482933.600935:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600941:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788482933.600944:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600951:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482933.600956:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482933.600961:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482933.600975:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600981:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482933.600987:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.600993:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a297 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a29e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601007:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482933.601009:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482933.601011:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482933.601019:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482933.601035:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098615808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482933.601088:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482933.601163:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482933.601179:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098616192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482933.601220:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482933.601256:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098615936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482933.601281:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482933.601306:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482933.601310:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098616064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482933.601335:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482933.601367:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098615808 00000100:00100000:0.0:1788482933.601373:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098615808 00010000:00010000:0.0:1788482933.601422:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 24 pid: 6487 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482933.601441:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616192 00000100:00100000:0.0:1788482933.601445:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616192 00010000:00010000:0.0:1788482933.601456:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e2a00/0x1d7ea3d89ea1a29e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 25 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482933.601465:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098615936 00000100:00100000:0.0:1788482933.601467:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098615936 00010000:00010000:0.0:1788482933.601476:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 26 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482933.601485:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616064 00000100:00100000:0.0:1788482933.601488:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616064 00010000:00010000:0.0:1788482933.601496:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 27 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482933.601510:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482933.601527:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+27:3622:x1875360098615808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482933.601542:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482933.601555:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 27 pid: 6487 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601567:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 27 pid: 6487 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601585:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1528c00/0x1d7ea3d89ea1a426 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a41f expref: 27 pid: 6487 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601602:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482933.601638:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+26:3622:x1875360098615808:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482933.601645:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482933.601662:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482933.601668:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:3622:x1875360098616192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482933.601675:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482933.601680:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e2a00/0x1d7ea3d89ea1a29e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 25 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601688:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e2a00/0x1d7ea3d89ea1a29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 25 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601697:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2a00/0x1d7ea3d89ea1a29e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a297 expref: 25 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601707:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482933.601728:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098616192:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482933.601734:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482933.601746:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482933.601758:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:3619:x1875360098615936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482933.601766:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482933.601771:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 23 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601778:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 23 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601788:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a300 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2f9 expref: 23 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601795:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482933.601821:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:3619:x1875360098615936:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482933.601827:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482933.601839:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788482933.601844:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3619:x1875360098616064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482933.601852:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482933.601856:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 21 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601863:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 21 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601872:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c1529800/0x1d7ea3d89ea1a2ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a2a5 expref: 21 pid: 6488 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.601881:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482933.601902:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3619:x1875360098616064:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482933.601915:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788482933.601991:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098616064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482933.602001:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098615936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482933.602033:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098616192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482933.602041:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098615808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788482933.606000:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482933.606551:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482933.606884:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087021952 00000100:00100000:0.0:1788482933.606898:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087021952 00010000:00010000:0.0:1788482933.606952:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 10 pid: 6486 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482933.607000:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:0.0:1788482933.607012:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+10:2393:x1875360087021952:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482933.607030:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482933.607036:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 10 pid: 6486 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607051:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 10 pid: 6486 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607079:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607090:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607143:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607171:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607178:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607184:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607191:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8bc00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788482933.607196:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607205:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607216:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482933.607227:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482933.607297:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+10:2393:x1875360087021952:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 287us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482933.607306:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 39 00010000:00010000:3.0:1788482933.609011:0:10371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1a53e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e118 expref: 9 pid: 6486 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482933.609037:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1875360098615168:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788482933.609086:0:10371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482933.609138:0:10371:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482933.609144:0:10371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482933.609150:0:10371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a602 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482933.882836:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482934.669615:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482934.669713:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022080 00000100:00100000:3.0:1788482934.669727:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022080 00000100:00100000:3.0:1788482934.669805:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 250 00000100:00100000:3.0:1788482934.669818:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+9:6166:x1875360087022080:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482934.669842:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482934.669872:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e15e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482934.669910:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482934.669922:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482934.669932:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76200, rc 0) 00000100:00100000:3.0:1788482934.669995:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087022080:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 180us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482934.670004:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 250 00000100:00100000:3.0:1788482934.673291:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482934.673395:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022208 00000100:00100000:1.0:1788482934.673408:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022208 00000100:00100000:1.0:1788482934.673479:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 251 00000100:00100000:1.0:1788482934.673491:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087022208:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482934.673714:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087022208:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 224us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482934.673724:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 251 00000100:00100000:1.0:1788482934.677654:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482934.677758:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022336 00000100:00100000:3.0:1788482934.677771:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022336 00000100:00100000:3.0:1788482934.677838:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 252 00000100:00100000:3.0:1788482934.677850:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087022336:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482934.678051:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:6166:x1875360087022336:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 201us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482934.678060:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 252 00000100:00100000:1.0:1788482934.681333:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482934.681831:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022464 00000100:00100000:3.0:1788482934.681846:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022464 00000100:00100000:3.0:1788482934.681922:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 253 00000100:00100000:3.0:1788482934.681935:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:6707:x1875360087022464:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788482934.682139:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:6707:x1875360087022464:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 206us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482934.682148:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 253 00000100:00100000:0.0:1788482934.688525:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482934.688659:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022592 00000100:00100000:1.0:1788482934.688674:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022592 00000100:00100000:1.0:1788482934.688920:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 254 00000100:00100000:1.0:1788482934.688934:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6707:x1875360087022592:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482934.689442:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:6707:x1875360087022592:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 508us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482934.689452:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 254 00010000:00010000:1.0:1788482934.905560:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788482935.292627:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788482935.292637:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c1c41000 from 4 10000000:01000000:3.0:1788482935.292643:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788482935.292722:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482935.292738:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482935.292753:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482935.292784:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788482935.292873:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482935.292941:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3c9be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482935.293855:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616320 00000100:00100000:2.0:1788482935.293870:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616320 00000100:00100000:2.0:1788482935.293944:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788482935.293957:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098616320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482935.293975:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482935.293995:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a610 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.294029:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.294041:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.294052:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1c00, rc 0) 00000100:00100000:2.0:1788482935.294148:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098616320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482935.294155:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788482935.295091:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482935.295185:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.295196:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482935.295342:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.295570:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.295617:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716000 going to sleep for 11 seconds 00000100:00100000:2.0:1788482935.295731:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616448 00000100:00100000:2.0:1788482935.295738:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616448 00000100:00100000:2.0:1788482935.295794:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788482935.295805:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098616448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.295984:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098616448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482935.295991:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788482935.296361:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.296539:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.296591:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.296628:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716000 going to sleep for 11 seconds 00000100:00100000:3.0:1788482935.296775:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616576 00000100:00100000:3.0:1788482935.296783:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616576 00000100:00100000:3.0:1788482935.296838:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788482935.296847:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098616576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482935.296975:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098616576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482935.296984:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788482935.297170:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.297693:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10421:1875360098616704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482935.297756:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482935.297793:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8985a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.297849:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616704 00000100:00100000:1.0:1788482935.297856:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616704 00000100:00100000:1.0:1788482935.298666:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788482935.298681:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10421:x1875360098616704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482935.298860:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10421:x1875360098616704:12345-0@lo:502:llog_process_th.0 Request processed in 184us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.298876:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788482935.299002:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10421:1875360098616704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482935.299049:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482935.299063:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482935.299066:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788482935.299075:0:10421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c1c41000 00000020:00000080:3.0:1788482935.299078:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788482935.299209:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10421:1875360098616832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482935.299263:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482935.309320:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616832 00000100:00100000:2.0:1788482935.309344:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616832 00000100:00100000:2.0:1788482935.309422:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788482935.311573:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10421:x1875360098616832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482935.312029:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:10421:x1875360098616832:12345-0@lo:502:llog_process_th.0 Request processed in 2596us (12764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482935.312041:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788482935.313827:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3c9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788482935.313877:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10421:1875360098616832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482935.313923:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482935.313934:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482935.313937:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788482935.313942:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788482935.314544:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788482935.314576:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482935.314592:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.314606:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482935.314618:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788482935.314622:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69e00f6800 from 4 10000000:01000000:1.0:1788482935.314625:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482935.314668:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.314676:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.314688:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482935.314715:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.315615:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.315927:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482935.318601:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098616960 00000100:00100000:3.0:1788482935.318624:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098616960 00000100:00100000:3.0:1788482935.318720:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788482935.318733:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098616960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482935.318758:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482935.318798:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a61e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482935.318834:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482935.318847:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482935.318857:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76e00, rc 0) 00000100:00100000:3.0:1788482935.318956:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098616960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (3343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482935.318964:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788482935.321552:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098616960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482935.321592:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.321608:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482935.321740:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.321821:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.321883:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2716780 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.321907:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617088 00000100:00100000:1.0:1788482935.321913:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617088 00000100:00100000:1.0:1788482935.321968:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788482935.321978:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098617088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.322151:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098617088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.322160:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788482935.323545:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.323611:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.323711:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482935.323763:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.323934:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617216 00000100:00100000:1.0:1788482935.323942:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617216 00000100:00100000:1.0:1788482935.324005:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788482935.324015:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098617216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.324165:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098617216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.324341:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788482935.325085:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.327091:0:10424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10424:1875360098617344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482935.327972:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482935.329538:0:10424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725900 going to sleep for 11 seconds 00000100:00100000:2.0:1788482935.330331:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617344 00000100:00100000:2.0:1788482935.330346:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617344 00000100:00100000:2.0:1788482935.330426:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788482935.330640:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10424:x1875360098617344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482935.331145:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10424:x1875360098617344:12345-0@lo:502:llog_process_th.0 Request processed in 508us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482935.331155:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788482935.335696:0:10424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10424:1875360098617344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482935.336042:0:10424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482935.336058:0:10424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482935.336061:0:10424:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788482935.336078:0:10424:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69e00f6800 00000020:00000080:0.0:1788482935.336081:0:10424:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788482935.336675:0:10424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10424:1875360098617472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482935.336784:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482935.336841:0:10424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.345044:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617472 00000100:00100000:1.0:1788482935.345065:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617472 00000100:00100000:1.0:1788482935.345170:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788482935.345183:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10424:x1875360098617472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482935.346599:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:10424:x1875360098617472:12345-0@lo:502:llog_process_th.0 Request processed in 1406us (9803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.346616:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788482935.349589:0:10424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10424:1875360098617472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482935.349657:0:10424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482935.349672:0:10424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482935.349674:0:10424:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788482935.349679:0:10424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788482935.350072:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788482935.350126:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788482935.350141:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.350185:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482935.350199:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788482935.350202:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69c5051000 from 4 10000000:01000000:2.0:1788482935.350205:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482935.350254:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.350264:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.350275:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482935.350301:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.350396:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482935.350626:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482935.350799:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617600 00000100:00100000:0.0:1788482935.350809:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617600 00000100:00100000:0.0:1788482935.353616:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788482935.353651:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098617600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482935.353677:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482935.353705:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a62c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482935.353746:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482935.353759:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482935.353769:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:0.0:1788482935.353872:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098617600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (3475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482935.353880:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788482935.354027:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482935.354051:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.354063:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482935.354203:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.354244:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482935.354309:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482935.356593:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617728 00000100:00100000:0.0:1788482935.356625:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617728 00000100:00100000:0.0:1788482935.356697:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788482935.356709:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098617728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482935.356926:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098617728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482935.356934:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788482935.357246:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.357317:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.357380:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482935.357417:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788482935.357575:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617856 00000100:00100000:2.0:1788482935.357581:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617856 00000100:00100000:2.0:1788482935.357619:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788482935.357626:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098617856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.357715:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098617856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482935.357722:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788482935.357762:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098617856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482935.360343:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10427:1875360098617984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482935.363800:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.363874:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482935.367235:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098617984 00000100:00100000:3.0:1788482935.367258:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098617984 00000100:00100000:3.0:1788482935.367393:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788482935.367405:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10427:x1875360098617984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482935.367640:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10427:x1875360098617984:12345-0@lo:502:llog_process_th.0 Request processed in 236us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482935.367649:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788482935.373080:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10427:1875360098617984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788482935.373170:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482935.373185:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482935.373187:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788482935.373196:0:10427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69c5051000 00000020:00000080:1.0:1788482935.373199:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788482935.373705:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10427:1875360098618112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482935.373806:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.373855:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725840 going to sleep for 11 seconds 00000100:00100000:2.0:1788482935.377305:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098618112 00000100:00100000:2.0:1788482935.377327:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098618112 00000100:00100000:2.0:1788482935.377416:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788482935.377590:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10427:x1875360098618112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482935.377818:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:10427:x1875360098618112:12345-0@lo:502:llog_process_th.0 Request processed in 390us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.378077:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10427:1875360098618112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788482935.378141:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788482935.378151:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482935.378153:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788482935.378159:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:2.0:1788482935.380307:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000020:01000000:2.0:1788482935.380401:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788482935.380709:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788482935.380726:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.380740:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482935.380769:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788482935.380773:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d20cc000 from 4 10000000:01000000:2.0:1788482935.380776:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482935.380822:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.381345:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482935.381362:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482935.381402:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098618240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788482935.382293:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482935.382348:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.382804:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098618240 00000100:00100000:1.0:1788482935.382817:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098618240 00000100:00100000:1.0:1788482935.383015:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788482935.383028:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098618240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482935.383048:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482935.383075:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a63a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.383148:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.383160:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.383171:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8ba00, rc 0) 00000100:00100000:1.0:1788482935.383239:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098618240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.383247:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788482935.383311:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098618240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482935.383331:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482935.383342:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482935.384022:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098618368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.384069:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.384128:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.384146:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098618368 00000100:00100000:1.0:1788482935.384152:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098618368 00000100:00100000:1.0:1788482935.384187:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788482935.384195:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098618368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.384327:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098618368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.384349:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788482935.384532:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098618368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.384570:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098618496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.384618:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482935.384640:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.384653:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098618496 00000100:00100000:1.0:1788482935.384657:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098618496 00000100:00100000:1.0:1788482935.384680:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788482935.384687:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098618496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482935.384774:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098618496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.384782:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788482935.384823:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098618496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482935.385226:0:10430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10430:1875360098618624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482935.385266:0:10430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482935.385291:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098618624 00000100:00100000:3.0:1788482935.385295:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098618624 00000100:00100000:3.0:1788482935.385322:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788482935.385330:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:10430:x1875360098618624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482935.385431:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:10430:x1875360098618624:12345-0@lo:502:llog_process_th.0 Request processed in 101us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482935.385447:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788482935.385486:0:10430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3c9b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482935.385501:0:10430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10430:1875360098618624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482935.385536:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482935.385547:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482935.385550:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788482935.385557:0:10430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69d20cc000 00000020:00000080:3.0:1788482935.385559:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788482935.385954:0:10430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10430:1875360098618752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482935.385989:0:10430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482935.386004:0:10430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3c9b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482935.386172:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098618752 00000100:00100000:1.0:1788482935.386178:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098618752 00000100:00100000:1.0:1788482935.386216:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788482935.386224:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:10430:x1875360098618752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482935.386318:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:10430:x1875360098618752:12345-0@lo:502:llog_process_th.0 Request processed in 95us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482935.386326:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788482935.386481:0:10430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:10430:1875360098618752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482935.386516:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482935.386523:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482935.386525:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788482935.386530:0:10430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788482935.386608:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788482935.386633:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788482935.386647:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482935.386660:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482935.928534:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482935.950784:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482935.950834:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482935.950866:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482935.950887:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482935.950918:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482935.950952:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022848 00000100:00100000:0.0:1788482935.950964:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022848 00000100:00100000:0.0:1788482935.951043:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022976 00000100:00100000:0.0:1788482935.951047:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022976 00000100:00100000:0.0:1788482935.951074:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:0.0:1788482935.951092:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087022848:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482935.951236:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087022848:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 146us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482935.951245:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:0.0:1788482935.951267:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:0.0:1788482935.951275:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087022976:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482935.951302:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087022976:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482935.951307:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00080000:0.0:1788482935.951337:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788482935.951341:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482935.951578:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087023104 00000100:00100000:2.0:1788482935.951584:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087023104 00000100:00100000:2.0:1788482935.951642:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087023232 00000100:00100000:2.0:1788482935.951646:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087023232 00000100:00100000:2.0:1788482935.951667:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:2.0:1788482935.951675:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087023104:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482935.951704:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087023104:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 32us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482935.951711:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:2.0:1788482935.951723:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:2.0:1788482935.951728:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087023232:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482935.951748:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087023232:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 20us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482935.951760:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00080000:2.0:1788482935.951784:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788482935.951787:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788482935.952215:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087022720 00000100:00100000:3.0:1788482935.952224:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087022720 00000100:00100000:3.0:1788482935.952278:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 275 00000100:00100000:3.0:1788482935.952296:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2393:x1875360087022720:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482935.952350:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2393:x1875360087022720:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 56us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482935.952356:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 275 00000100:00100000:0.0:1788482936.057383:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098618880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788482936.057483:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482936.057716:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098618880 00000100:00100000:2.0:1788482936.057726:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098618880 00000100:00100000:2.0:1788482936.058132:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788482936.058148:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098618880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788482936.058193:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788482936.058265:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098618880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482936.058273:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788482936.058573:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098618880:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788482936.955856:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482937.082291:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098619008:0@lo:400:kworker.0 00000100:00100000:2.0:1788482937.082364:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098619392:0@lo:400:kworker.0 00000100:00100000:3.0:1788482937.082449:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098619264:0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.082449:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098619136:0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.085922:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482937.085956:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482937.086015:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098619904:0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.086034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098619520:0@lo:400:kworker.0 00000100:00100000:2.0:1788482937.086060:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482937.086062:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482937.086081:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098620416:0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.086083:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098620032:0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.086118:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482937.086140:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619904 00000100:00100000:0.0:1788482937.086140:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098620544:0@lo:400:kworker.0 00000100:00100000:2.0:1788482937.086150:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619904 00000100:00100000:0.0:1788482937.086160:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482937.086205:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619392 00000100:00100000:0.0:1788482937.086208:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619392 00000100:00100000:2.0:1788482937.086210:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620032 00000100:00100000:2.0:1788482937.086212:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620032 00000100:00100000:2.0:1788482937.086226:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620544 00000100:00100000:2.0:1788482937.086229:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620544 00000100:00100000:0.0:1788482937.086240:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788482937.086243:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482937.086249:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098619904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.086249:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098619392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482937.086308:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098619904:12345-0@lo:400:kworker.0 Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.086308:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098619392:12345-0@lo:400:kworker.0 Request processed in 60us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.086315:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788482937.086332:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788482937.086340:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619520 00000100:00100000:2.0:1788482937.086342:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788482937.086344:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619520 00000100:00100000:2.0:1788482937.086348:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098620032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482937.086381:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098620032:12345-0@lo:400:kworker.0 Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.086381:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788482937.086387:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788482937.086388:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098619520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482937.086411:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482937.086417:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098620544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.086433:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098619520:12345-0@lo:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482937.086442:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098620544:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.086446:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788482937.086447:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788482937.086462:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482937.086466:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788482937.086467:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482937.086487:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620416 00000100:00100000:2.0:1788482937.086490:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620416 00000100:00100000:2.0:1788482937.086526:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788482937.086529:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098619392:0@lo:400:kworker.0 00000100:00100000:2.0:1788482937.086531:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098620416:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788482937.086860:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde8a80 x1875360098619904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482937.086873:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098619904:0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.086926:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098619520:0@lo:400:kworker.0 00010000:00080000:0.0:1788482937.086939:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde8000 x1875360098620032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482937.086947:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098620032:0@lo:400:kworker.0 00010000:00080000:0.0:1788482937.086957:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efdea300 x1875360098620544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482937.086965:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098620544:0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.087045:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482937.087055:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098620672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482937.087088:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482937.087157:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620672 00000100:00100000:0.0:1788482937.087162:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620672 00000100:00100000:0.0:1788482937.087192:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788482937.087198:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098620672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788482937.087224:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482937.087260:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098620672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.087279:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788482937.087306:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376a680 x1875360098620672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482937.087320:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098620672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482937.087855:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619008 00000100:00100000:0.0:1788482937.087865:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619008 00000100:00100000:0.0:1788482937.087908:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788482937.087916:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098619008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.087972:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098619008:12345-0@lo:400:kworker.0 Request processed in 58us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.087979:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788482937.088022:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098619008:0@lo:400:kworker.0 00000100:00080000:0.0:1788482937.088054:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788482937.088468:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098620416:12345-0@lo:400:kworker.0 Request processed in 1934us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482937.088478:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482937.088602:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482937.088715:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098619648:0@lo:400:kworker.0 00010000:00080000:0.0:1788482937.088727:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde8e00 x1875360098620416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482937.088742:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098620416:0@lo:400:kworker.0 00000100:00100000:3.0:1788482937.088814:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482937.088880:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098619776:0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.088880:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482937.088901:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098620160:0@lo:400:kworker.0 00000100:00100000:3.0:1788482937.088903:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482937.088920:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098620288:0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.088921:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482937.088940:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482937.088945:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619136 00000100:00100000:1.0:1788482937.088949:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619136 00000100:00100000:3.0:1788482937.088963:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619648 00000100:00100000:3.0:1788482937.088966:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619648 00000100:00100000:1.0:1788482937.088977:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619776 00000100:00100000:1.0:1788482937.088980:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619776 00000100:00100000:3.0:1788482937.088990:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620160 00000100:00100000:1.0:1788482937.088991:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620288 00000100:00100000:3.0:1788482937.088992:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620160 00000100:00100000:1.0:1788482937.088993:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620288 00000100:00100000:1.0:1788482937.089006:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788482937.089014:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098619136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482937.089021:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788482937.089026:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098619648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482937.089054:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098619648:12345-0@lo:400:kworker.0 Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482937.089054:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098619136:12345-0@lo:400:kworker.0 Request processed in 41us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482937.089061:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788482937.089357:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098619264 00000100:00100000:0.0:1788482937.089362:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098619264 00000100:00100000:0.0:1788482937.089405:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788482937.089412:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098619264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.089979:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098619264:12345-0@lo:400:kworker.0 Request processed in 565us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.089988:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788482937.090027:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788482937.090045:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788482937.090055:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098619776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482937.090071:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098619136:0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.090091:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098619776:12345-0@lo:400:kworker.0 Request processed in 40us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482937.090113:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788482937.090121:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098619648:0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.090125:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788482937.090131:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098620288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.090160:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098620288:12345-0@lo:400:kworker.0 Request processed in 29us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482937.090165:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788482937.090177:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788482937.090184:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098620160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.090231:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098620160:12345-0@lo:400:kworker.0 Request processed in 48us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482937.090238:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788482937.090245:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788482937.090251:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482937.090267:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098620160:0@lo:400:kworker.0 00000100:00100000:3.0:1788482937.090351:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098619264:0@lo:400:kworker.0 00010000:00080000:3.0:1788482937.090745:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efdead80 x1875360098619776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482937.090906:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098619776:0@lo:400:kworker.0 00010000:00080000:3.0:1788482937.090929:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde9880 x1875360098620288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482937.090951:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098620288:0@lo:400:kworker.0 00000100:00100000:1.0:1788482937.595520:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098620800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788482937.595851:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482937.596078:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620800 00000100:00100000:0.0:1788482937.596090:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620800 00000100:00100000:0.0:1788482937.596177:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788482937.596187:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098620800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788482937.596216:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482937.596274:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098620800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.596281:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788482937.596381:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3077b80 x1875360098620800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482937.596406:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098620800:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788482937.981796:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482938.616439:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098620928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788482938.616542:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482938.616632:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098620928 00000100:00100000:3.0:1788482938.616641:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098620928 00000100:00100000:3.0:1788482938.616698:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788482938.616707:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098620928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788482938.616749:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482938.616800:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098620928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482938.616807:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788482938.616858:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098620928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482938.617837:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098621056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482938.617893:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482938.618464:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098621184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482938.618668:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482938.636073:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621056 00000100:00100000:2.0:1788482938.636129:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621056 00000100:00100000:2.0:1788482938.636190:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621184 00000100:00100000:2.0:1788482938.636194:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621184 00000100:00100000:2.0:1788482938.636216:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788482938.636227:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098621056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788482938.636269:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482938.636361:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098621056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (18466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482938.636369:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788482938.636390:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788482938.636397:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098621184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482938.636408:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482938.636435:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098621184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (17767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482938.636441:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788482938.638797:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87480 x1875360098621056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482938.638832:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098621056:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788482938.638944:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37f9500 x1875360098621184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482938.638959:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098621184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788482939.006827:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482940.024345:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482941.056562:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482941.072984:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482941.073264:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482941.073304:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482941.073351:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482941.073379:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482941.073425:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087023744 00000100:00100000:3.0:1788482941.073438:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087023744 00000100:00100000:3.0:1788482941.073521:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087023872 00000100:00100000:3.0:1788482941.073525:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087023872 00000100:00100000:1.0:1788482941.077383:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087023488 00000100:00100000:1.0:1788482941.077404:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087023488 00000100:00100000:1.0:1788482941.077503:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087023616 00000100:00100000:1.0:1788482941.077508:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087023616 00000100:00100000:1.0:1788482941.077545:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 75 00000100:00100000:1.0:1788482941.077557:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087023488:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482941.077684:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087023488:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 130us (4420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482941.077693:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 75 00000100:00100000:1.0:1788482941.077714:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 76 00000100:00100000:1.0:1788482941.077720:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087023616:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482941.077748:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087023616:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482941.077755:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 76 00000100:00100000:3.0:1788482941.078966:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:3.0:1788482941.078989:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087023744:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482941.079058:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087023744:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 79us (5753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482941.079086:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:3.0:1788482941.079121:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:3.0:1788482941.079130:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087023872:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482941.079160:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087023872:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 32us (5781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482941.079167:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00080000:3.0:1788482941.080186:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788482941.080195:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482941.080199:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482941.080203:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482941.081694:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087023360 00000100:00100000:0.0:1788482941.081714:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087023360 00000100:00100000:0.0:1788482941.081849:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 277 00000100:00100000:0.0:1788482941.081864:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2393:x1875360087023360:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482941.081967:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2393:x1875360087023360:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 106us (8997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482941.081991:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 277 00000100:00100000:0.0:1788482941.176834:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482941.176865:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098621312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788482941.176957:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482941.177067:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621312 00000100:00100000:2.0:1788482941.177078:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621312 00000100:00100000:2.0:1788482941.177162:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788482941.177174:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098621312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788482941.177216:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788482941.177277:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098621312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482941.177285:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788482941.177336:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098621312:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788482941.870607:0:10671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788482942.074199:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482942.200360:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098621568:0@lo:400:kworker.0 00000100:00100000:2.0:1788482942.200458:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482942.200534:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098622080:0@lo:400:kworker.0 00000100:00100000:2.0:1788482942.200560:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482942.200583:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098622592:0@lo:400:kworker.0 00000100:00100000:2.0:1788482942.200611:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482942.200635:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788482942.200641:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098621696:0@lo:400:kworker.0 00000100:00100000:2.0:1788482942.200666:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482942.200683:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098622208:0@lo:400:kworker.0 00000100:00100000:2.0:1788482942.200705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482942.200719:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098622720:0@lo:400:kworker.0 00000100:00100000:2.0:1788482942.200755:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482942.200767:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621568 00000100:00100000:2.0:1788482942.200771:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098623104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482942.200775:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621568 00000100:00100000:2.0:1788482942.200801:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482942.200841:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098623104 00000100:00100000:2.0:1788482942.200845:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098623104 00000100:00100000:1.0:1788482942.200877:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622080 00000100:00100000:2.0:1788482942.200885:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788482942.200886:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622080 00000100:00100000:2.0:1788482942.200894:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098623104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482942.200902:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622592 00000100:00100000:1.0:1788482942.200904:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622592 00000100:00100000:1.0:1788482942.200916:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622208 00000100:00100000:1.0:1788482942.200918:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622208 00000100:00100000:1.0:1788482942.200931:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622720 00000100:00100000:1.0:1788482942.200934:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622720 00000100:00100000:3.0:1788482942.200952:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098621440:0@lo:400:kworker.0 00000100:00100000:1.0:1788482942.200952:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788482942.200960:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098621568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.200997:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482942.201026:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098621952:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.201050:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482942.201070:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098622464:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.201123:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482942.201142:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098622976:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.201163:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482942.201183:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788482942.201189:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098621824:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.201210:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482942.201224:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098622336:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.201246:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482942.201281:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098622848:0@lo:400:kworker.0 00000100:00100000:1.0:1788482942.201294:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098621568:12345-0@lo:400:kworker.0 Request processed in 334us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482942.201303:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788482942.201314:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482942.201325:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621824 00000100:00100000:1.0:1788482942.201329:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621824 00000100:00100000:1.0:1788482942.201349:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788482942.201357:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621696 00000100:00100000:1.0:1788482942.201357:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098622080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.201363:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621696 00000100:00100000:3.0:1788482942.201409:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621952 00000100:00100000:3.0:1788482942.201413:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621952 00000100:00100000:3.0:1788482942.201429:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788482942.201436:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098621696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482942.201905:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098622080:12345-0@lo:400:kworker.0 Request processed in 548us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482942.201913:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788482942.201931:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788482942.201939:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098622592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.201962:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098621696:12345-0@lo:400:kworker.0 Request processed in 524us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.201970:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788482942.201985:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788482942.201992:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098621952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.202032:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098621952:12345-0@lo:400:kworker.0 Request processed in 41us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.202039:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788482942.202063:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788482942.202072:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098622208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.202148:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098622208:12345-0@lo:400:kworker.0 Request processed in 78us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.202155:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788482942.202169:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788482942.202176:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098622720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.202203:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098622720:12345-0@lo:400:kworker.0 Request processed in 28us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.202209:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788482942.202232:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788482942.202239:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098621824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482942.202243:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098622592:12345-0@lo:400:kworker.0 Request processed in 303us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482942.202252:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788482942.202279:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098621824:12345-0@lo:400:kworker.0 Request processed in 40us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.202287:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788482942.202315:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788482942.202321:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482942.202325:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788482942.202328:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098621696:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.202342:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098621440 00010000:00080000:1.0:1788482942.202348:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87480 x1875360098622208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482942.202349:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098621440 00000100:00100000:1.0:1788482942.202378:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098622208:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.202387:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00010000:00080000:1.0:1788482942.202402:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd935880 x1875360098622720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482942.202412:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098622720:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.202416:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098621440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482942.202431:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098621568:0@lo:400:kworker.0 00000100:00100000:1.0:1788482942.202931:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098622080:0@lo:400:kworker.0 00000100:00100000:1.0:1788482942.202952:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098622592:0@lo:400:kworker.0 00002000:00000024:2.0:1788482942.203870:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482942.203947:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098621440:12345-0@lo:400:kworker.0 Request processed in 1549us (2947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.203958:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788482942.204028:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622464 00000100:00100000:3.0:1788482942.204035:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622464 00000100:00100000:3.0:1788482942.204076:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622976 00000100:00100000:3.0:1788482942.204080:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622976 00000100:00100000:3.0:1788482942.204092:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622336 00000100:00100000:3.0:1788482942.204110:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622336 00000100:00100000:3.0:1788482942.204128:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098622848 00000100:00100000:3.0:1788482942.204143:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098622848 00000100:00100000:3.0:1788482942.204161:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788482942.204169:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098622464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482942.204223:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098623104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3327us (3417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.204224:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098622464:12345-0@lo:400:kworker.0 Request processed in 53us (3127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.204240:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788482942.204243:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788482942.204254:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788482942.204270:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098622976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.204305:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098622976:12345-0@lo:400:kworker.0 Request processed in 36us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.204312:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788482942.204325:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788482942.204331:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098622336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.204354:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098622336:12345-0@lo:400:kworker.0 Request processed in 24us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.204360:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788482942.204369:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788482942.204374:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098622848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.205604:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098622848:12345-0@lo:400:kworker.0 Request processed in 1220us (4282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482942.205616:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788482942.205816:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482942.205821:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788482942.205869:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098621824:0@lo:400:kworker.0 00010000:00080000:3.0:1788482942.205890:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd932d80 x1875360098622336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482942.205902:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098622336:0@lo:400:kworker.0 00010000:00080000:3.0:1788482942.205915:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd935500 x1875360098622848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482942.205925:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098622848:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.205937:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098621440:0@lo:400:kworker.0 00000100:00100000:3.0:1788482942.205964:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098621952:0@lo:400:kworker.0 00010000:00080000:3.0:1788482942.205977:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd933b80 x1875360098622464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482942.205984:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098622464:0@lo:400:kworker.0 00010000:00080000:3.0:1788482942.205996:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd936a00 x1875360098622976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482942.206003:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098622976:0@lo:400:kworker.0 00010000:00080000:1.0:1788482942.206626:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3077b80 x1875360098623104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482942.206650:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098623104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482942.713002:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482942.713036:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098623232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788482942.713166:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482942.713273:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098623232 00000100:00100000:1.0:1788482942.713284:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098623232 00000100:00100000:1.0:1788482942.713501:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788482942.713513:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098623232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482942.713544:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482942.713602:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098623232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482942.713611:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788482942.713658:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3077b80 x1875360098623232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482942.713696:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098623232:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788482943.097982:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482943.740502:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098623360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788482943.740608:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482943.740705:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098623360 00000100:00100000:2.0:1788482943.740715:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098623360 00000100:00100000:2.0:1788482943.740782:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788482943.740794:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098623360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788482943.740833:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482943.740885:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098623360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482943.740893:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788482943.740939:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fb100 x1875360098623360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482943.740961:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098623360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788482943.742308:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482943.742332:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098623488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482943.742397:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482943.742871:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098623488 00000100:00100000:2.0:1788482943.742883:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098623488 00000100:00100000:2.0:1788482943.742947:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788482943.742957:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098623488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482943.742982:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482943.743039:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098623488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482943.743046:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788482943.743124:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3c78a80 x1875360098623488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482943.743146:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098623488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482943.744786:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482943.747238:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098623616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788482943.747400:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482943.747975:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098623616 00000100:00100000:0.0:1788482943.747990:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098623616 00000100:00100000:3.0:1788482943.748176:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788482943.748191:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098623616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788482943.748242:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482943.748322:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098623616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482943.748330:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788482943.748445:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098623616:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788482944.120662:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482945.149155:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482946.168246:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482946.197655:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482946.197695:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482946.197725:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482946.197747:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482946.197791:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482946.197835:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024256 00000100:00100000:3.0:1788482946.197848:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024256 00000100:00100000:3.0:1788482946.197916:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024128 00000100:00100000:3.0:1788482946.197920:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024128 00000100:00100000:3.0:1788482946.197947:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 83 00000100:00100000:3.0:1788482946.197958:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087024256:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482946.198029:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024384 00000100:00100000:2.0:1788482946.198035:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024384 00000100:00100000:3.0:1788482946.198058:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087024256:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 100us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482946.198067:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 83 00000100:00100000:2.0:1788482946.198076:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024512 00000100:00100000:2.0:1788482946.198080:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024512 00000100:00100000:3.0:1788482946.198091:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 84 00000100:00100000:3.0:1788482946.198123:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087024128:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482946.198149:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788482946.198155:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087024128:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 55us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482946.198163:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2389:x1875360087024384:12345-192.168.206.54@tcp:9:kworker.0 00000100:00100000:3.0:1788482946.198164:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 84 00000100:00080000:3.0:1788482946.198192:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482946.198197:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482946.198201:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788482946.198201:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a553 00000100:00080000:3.0:1788482946.198206:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788482946.198215:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788482946.198276:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788482946.198477:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+2:2389:x1875360087024384:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 317us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482946.198485:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:2.0:1788482946.198501:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:2.0:1788482946.198508:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2389:x1875360087024512:12345-192.168.206.54@tcp:9:kworker.0 00000020:00000080:2.0:1788482946.198523:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a55a 00000100:00080000:2.0:1788482946.198530:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9a69ece24800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788482946.198564:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788482946.198643:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+2:2389:x1875360087024512:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 135us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482946.198650:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00010000:00010000:2.0:1788482946.198737:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482946.198745:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482946.199702:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024000 00000100:00100000:0.0:1788482946.199714:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024000 00000100:00100000:0.0:1788482946.199763:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 279 00000100:00100000:0.0:1788482946.199772:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087024000:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482946.200236:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087024000:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 461us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482946.200246:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 279 00000100:00100000:3.0:1788482946.297052:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482946.297090:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098623744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788482946.297208:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482946.297305:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098623744 00000100:00100000:3.0:1788482946.297316:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098623744 00000100:00100000:3.0:1788482946.297702:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788482946.297715:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098623744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788482946.297761:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482946.297824:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098623744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482946.297849:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788482946.297915:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098623744:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788482947.192425:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482947.321350:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482947.321389:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098623872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482947.321483:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482947.321523:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098623872 00000100:00100000:3.0:1788482947.321533:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098623872 00000100:00080000:1.0:1788482947.321567:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788482947.321608:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788482947.321620:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098623872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482947.321655:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482947.321714:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098623872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482947.321722:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788482947.321769:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3077b80 x1875360098623872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482947.321794:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098623872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482947.322165:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098624000:0@lo:400:kworker.0 00000100:00100000:3.0:1788482947.322208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482947.322353:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624000 00000100:00100000:1.0:1788482947.322359:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624000 00000100:00100000:1.0:1788482947.322411:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788482947.322419:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098624000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.328869:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098624128:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.328960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329002:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098624640:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329026:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329044:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098625152:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329068:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329131:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788482947.329139:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098624256:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329171:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329204:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098624768:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329227:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329244:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098625280:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329263:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329297:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624128 00000100:00100000:0.0:1788482947.329306:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624128 00000100:00100000:0.0:1788482947.329350:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624640 00000100:00100000:0.0:1788482947.329353:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624640 00000100:00100000:0.0:1788482947.329382:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625152 00000100:00100000:0.0:1788482947.329385:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625152 00000100:00100000:0.0:1788482947.329398:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624768 00000100:00100000:0.0:1788482947.329401:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624768 00000100:00100000:0.0:1788482947.329413:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625280 00000100:00100000:0.0:1788482947.329415:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625280 00000100:00100000:0.0:1788482947.329432:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788482947.329443:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098624128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329522:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098624128:12345-0@lo:400:kworker.0 Request processed in 80us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.329529:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788482947.329549:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788482947.329554:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098624640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329582:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098624640:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.329589:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788482947.329599:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788482947.329604:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098625152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329644:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098625152:12345-0@lo:400:kworker.0 Request processed in 40us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.329666:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788482947.329680:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788482947.329686:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098624768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329715:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098624768:12345-0@lo:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.329719:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788482947.329729:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788482947.329735:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098625280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329757:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098625280:12345-0@lo:400:kworker.0 Request processed in 22us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.329762:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788482947.329790:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624256 00000100:00100000:0.0:1788482947.329794:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624256 00000100:00100000:0.0:1788482947.329821:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788482947.329828:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098624256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329857:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098624256:12345-0@lo:400:kworker.0 Request processed in 30us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.329862:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788482947.329881:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788482947.329886:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482947.329898:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098624384:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329923:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329938:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098624896:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.329961:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.329980:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098625408:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330006:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.330024:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788482947.330029:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098624512:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330048:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.330062:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098625024:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330078:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482947.330126:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624896 00000100:00100000:0.0:1788482947.330129:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624896 00000100:00100000:0.0:1788482947.330157:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625408 00000100:00100000:0.0:1788482947.330160:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625408 00000100:00100000:0.0:1788482947.330171:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625024 00000100:00100000:0.0:1788482947.330173:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625024 00000100:00100000:0.0:1788482947.330184:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482947.330189:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098624896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330220:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098624896:12345-0@lo:400:kworker.0 Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.330226:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482947.330235:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482947.330240:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098625408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330261:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098625408:12345-0@lo:400:kworker.0 Request processed in 21us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.330266:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482947.330274:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482947.330278:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098625024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330297:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098625024:12345-0@lo:400:kworker.0 Request processed in 19us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.330302:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482947.330327:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624512 00000100:00100000:0.0:1788482947.330330:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624512 00000100:00100000:0.0:1788482947.330351:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788482947.330356:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098624512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330384:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098624512:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.330390:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788482947.330410:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482947.330413:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482947.330455:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098624512:0@lo:400:kworker.0 00010000:00080000:0.0:1788482947.330470:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde9880 x1875360098625024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482947.330481:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098625024:0@lo:400:kworker.0 00010000:00080000:0.0:1788482947.330490:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769500 x1875360098624896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482947.330497:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098624896:0@lo:400:kworker.0 00010000:00080000:0.0:1788482947.330504:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde9180 x1875360098625408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482947.330512:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098625408:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330543:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098624256:0@lo:400:kworker.0 00010000:00080000:0.0:1788482947.330554:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376bb80 x1875360098624768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482947.330561:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098624768:0@lo:400:kworker.0 00010000:00080000:0.0:1788482947.330571:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde8700 x1875360098625280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482947.330587:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098625280:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330600:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098624128:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330612:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098624640:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330623:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098625152:0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330649:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098624384 00000100:00100000:0.0:1788482947.330653:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098624384 00000100:00100000:0.0:1788482947.330673:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788482947.330677:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098624384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482947.330706:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098624384:12345-0@lo:400:kworker.0 Request processed in 29us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482947.330712:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788482947.330734:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098624384:0@lo:400:kworker.0 00000100:00100000:1.0:1788482947.331583:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098624000:12345-0@lo:400:kworker.0 Request processed in 9157us (9366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482947.331596:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788482947.334316:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098624000:0@lo:400:kworker.0 00000001:02000400:2.0:1788482947.725711:0:10915:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing yml_node 00000100:00100000:3.0:1788482947.832392:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098625536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788482947.832505:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482947.832679:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625536 00000100:00100000:1.0:1788482947.832691:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625536 00000100:00100000:1.0:1788482947.832758:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788482947.832769:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098625536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482947.832799:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482947.832859:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098625536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482947.832867:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788482947.833068:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3075f80 x1875360098625536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482947.833089:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098625536:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788482948.218934:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482948.856633:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098625664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482948.856720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482948.856806:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625664 00000100:00100000:2.0:1788482948.856826:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625664 00000100:00100000:2.0:1788482948.856890:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788482948.856903:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098625664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482948.856944:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482948.856993:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098625664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482948.857000:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788482948.857033:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098625792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788482948.857061:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482948.857143:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625792 00000100:00100000:0.0:1788482948.857149:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625792 00010000:00080000:2.0:1788482948.857150:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fb100 x1875360098625664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482948.857176:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098625664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482948.857178:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788482948.857190:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098625792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788482948.857204:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482948.857251:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098625792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482948.857258:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788482948.857852:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098625920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482948.857902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482948.858007:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098625920 00000100:00100000:1.0:1788482948.858020:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098625920 00000100:00100000:1.0:1788482948.858318:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788482948.858329:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098625920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788482948.858364:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788482948.858411:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098625920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482948.858418:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788482948.858860:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4754380 x1875360098625792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482948.858889:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098625792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482948.858901:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098625920:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788482949.240277:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482950.264848:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482951.288869:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482951.318219:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482951.318272:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482951.318319:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482951.318421:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024896 00000100:00100000:2.0:1788482951.318446:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024896 00000100:00080000:1.0:1788482951.318623:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788482951.318740:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024640 00000100:00100000:0.0:1788482951.318763:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024640 00000100:00100000:0.0:1788482951.318816:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 281 00000100:00100000:0.0:1788482951.318827:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2391:x1875360087024640:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482951.318920:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2391:x1875360087024640:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 94us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482951.318929:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 281 00000100:00100000:2.0:1788482951.318942:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087024768 00000100:00100000:2.0:1788482951.318948:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087024768 00000100:00100000:2.0:1788482951.318990:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 91 00000100:00100000:2.0:1788482951.318999:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087024896:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482951.319040:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087024896:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 43us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482951.319048:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 91 00000100:00100000:2.0:1788482951.319066:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 92 00000100:00100000:2.0:1788482951.319081:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087024768:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482951.319145:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087024768:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 64us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482951.319152:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 92 00000100:00080000:3.0:1788482951.329984:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482951.418622:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788482951.418652:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098626048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788482951.418750:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482951.418852:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626048 00000100:00100000:2.0:1788482951.418862:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626048 00000100:00100000:2.0:1788482951.418922:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788482951.418933:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098626048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788482951.418991:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788482951.419047:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098626048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482951.419055:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788482951.419141:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098626048:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788482951.930584:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:2.0:1788482951.930596:0:8405:0:(genops.c:885:class_export_put()) final put ffff9a68c33c7000/d93ec387-f41f-455a-afdd-b6a72a2f59de 00000001:00100000:0.0:1788482951.930855:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:0.0:1788482951.930866:0:9489:0:(genops.c:885:class_export_put()) final put ffff9a69ece26000/d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:3.0:1788482951.930912:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33c7000/d93ec387-f41f-455a-afdd-b6a72a2f59de for lustre-OST0000 00000020:00000080:3.0:1788482951.930980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece26000/d93ec387-f41f-455a-afdd-b6a72a2f59de for lustre-OST0001 00000020:00000080:3.0:1788482951.931008:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd93000 for lustre-OST0000 00000020:00000080:3.0:1788482951.931013:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece24800 for lustre-OST0001 00000001:02000400:0.0:1788482952.304226:0:11099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00010000:00010000:2.0:1788482952.312554:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482952.441877:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098626176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482952.441950:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482952.447175:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626176 00000100:00100000:2.0:1788482952.447190:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626176 00000100:00100000:2.0:1788482952.447259:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788482952.447271:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098626176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788482952.447313:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482952.447386:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098626176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (5436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482952.447393:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788482952.447436:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788482952.447481:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb84700 x1875360098626176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482952.447502:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098626176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482952.448794:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098626304:0@lo:400:kworker.0 00000100:00100000:2.0:1788482952.448850:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482952.458953:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482952.458977:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098626688:0@lo:400:kworker.0 00000100:00100000:2.0:1788482952.459059:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482952.459137:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626304 00000100:00100000:2.0:1788482952.459146:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626304 00000100:00100000:2.0:1788482952.459197:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788482952.459207:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098626304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482952.459263:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098626304:12345-0@lo:400:kworker.0 Request processed in 57us (10412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482952.459272:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788482952.459313:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626688 00000100:00100000:2.0:1788482952.459317:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626688 00000100:00100000:2.0:1788482952.459346:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788482952.459352:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098626688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482952.459387:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098626688:12345-0@lo:400:kworker.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482952.459401:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788482952.459474:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098626688:0@lo:400:kworker.0 00000100:00100000:2.0:1788482952.459483:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098626304:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.459691:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098626432:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.459722:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.459744:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098626944:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.459766:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.459782:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098627456:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.459802:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.459818:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788482952.459824:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098626560:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.459846:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.459864:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098627072:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.459884:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.459901:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098627584:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.459920:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.459952:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626432 00000100:00100000:1.0:1788482952.459956:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626432 00000100:00100000:1.0:1788482952.459974:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626944 00000100:00100000:1.0:1788482952.459976:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626944 00000100:00100000:1.0:1788482952.459998:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627456 00000100:00100000:1.0:1788482952.460001:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627456 00000100:00100000:1.0:1788482952.460013:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627072 00000100:00100000:1.0:1788482952.460015:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627072 00000100:00100000:1.0:1788482952.460025:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627584 00000100:00100000:1.0:1788482952.460027:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627584 00000100:00100000:1.0:1788482952.460039:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788482952.460044:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098626432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460079:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098626432:12345-0@lo:400:kworker.0 Request processed in 33us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460085:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788482952.460124:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788482952.460132:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098626944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460160:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098626944:12345-0@lo:400:kworker.0 Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788482952.460177:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788482952.460184:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098627456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460210:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098627456:12345-0@lo:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460215:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788482952.460226:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788482952.460233:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098627072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460261:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098627072:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460275:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788482952.460289:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788482952.460300:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098627584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460338:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098627584:12345-0@lo:400:kworker.0 Request processed in 40us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460343:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788482952.460363:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626560 00000100:00100000:1.0:1788482952.460366:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626560 00000100:00100000:1.0:1788482952.460392:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788482952.460400:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098626560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460452:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098626560:12345-0@lo:400:kworker.0 Request processed in 54us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460459:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788482952.460483:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788482952.460488:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482952.460515:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098626560:0@lo:400:kworker.0 00010000:00080000:1.0:1788482952.460528:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb84380 x1875360098627072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482952.460537:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098627072:0@lo:400:kworker.0 00010000:00080000:1.0:1788482952.460545:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb84700 x1875360098627584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482952.460553:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098627584:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460562:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098626432:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460569:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098626944:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460588:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098627456:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460615:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098627200:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460642:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.460664:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098627712:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.460701:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788482952.460706:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098626816:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460724:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.460740:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098627328:0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460760:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482952.460786:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627200 00000100:00100000:1.0:1788482952.460790:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627200 00000100:00100000:1.0:1788482952.460815:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627712 00000100:00100000:1.0:1788482952.460818:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627712 00000100:00100000:1.0:1788482952.460828:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627328 00000100:00100000:1.0:1788482952.460830:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627328 00000100:00100000:1.0:1788482952.460840:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788482952.460845:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098627200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460876:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098627200:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460881:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788482952.460891:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788482952.460898:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098627712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460925:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098627712:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460931:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788482952.460950:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788482952.460958:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098627328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.460987:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098627328:12345-0@lo:400:kworker.0 Request processed in 31us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.460992:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788482952.461013:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098626816 00000100:00100000:1.0:1788482952.461016:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098626816 00000100:00100000:1.0:1788482952.461037:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788482952.461043:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098626816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482952.461069:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098626816:12345-0@lo:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482952.461075:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788482952.461094:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482952.461116:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482952.461136:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098626816:0@lo:400:kworker.0 00010000:00080000:1.0:1788482952.461146:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87480 x1875360098627328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482952.461154:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098627328:0@lo:400:kworker.0 00010000:00080000:1.0:1788482952.461162:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb86300 x1875360098627200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482952.461169:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098627200:0@lo:400:kworker.0 00010000:00080000:1.0:1788482952.461177:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3734380 x1875360098627712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482952.461184:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098627712:0@lo:400:kworker.0 00000100:00100000:0.0:1788482952.953365:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482952.953401:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098627840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788482952.953476:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482952.954222:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627840 00000100:00100000:2.0:1788482952.954232:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627840 00000100:00100000:2.0:1788482952.954292:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788482952.954302:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098627840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788482952.954322:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482952.954377:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098627840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482952.954384:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788482952.955183:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755880 x1875360098627840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482952.955215:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098627840:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788482953.340968:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482953.976999:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098628096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788482953.977064:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482953.977149:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482953.977157:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098627968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482953.977181:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482953.977254:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628096 00000100:00100000:0.0:1788482953.977262:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628096 00000100:00100000:0.0:1788482953.977303:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098627968 00000100:00100000:0.0:1788482953.977306:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098627968 00000100:00100000:0.0:1788482953.977322:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788482953.977330:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098628096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788482953.977359:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482953.977432:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098628096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482953.977440:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788482953.977459:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788482953.977466:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098627968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482953.977476:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482953.977501:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098627968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482953.977523:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788482953.977858:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f9180 x1875360098627968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482953.977877:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098627968:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788482953.977888:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755880 x1875360098628096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482953.977898:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098628096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788482953.979873:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482953.979897:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098628224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788482953.979955:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482953.980126:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628224 00000100:00100000:3.0:1788482953.980134:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628224 00000100:00100000:3.0:1788482953.980186:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788482953.980195:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098628224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788482953.980223:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482953.980270:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098628224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482953.980276:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788482953.980357:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098628224:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788482954.360493:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788482955.029784:0:11196:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00010000:00010000:2.0:1788482955.384702:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482956.410974:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482956.434207:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482956.434256:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482956.434265:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025024 00000100:00100000:3.0:1788482956.434274:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025024 00000100:00100000:3.0:1788482956.434331:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 283 00000100:00100000:3.0:1788482956.434341:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087025024:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482956.434431:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087025024:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482956.434439:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 283 00000100:00100000:0.0:1788482956.434640:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025152 00000100:00100000:0.0:1788482956.434645:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025152 00000100:00100000:0.0:1788482956.434695:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 99 00000100:00100000:0.0:1788482956.434702:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087025152:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482956.434734:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087025152:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 33us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482956.434741:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 99 00000100:00080000:3.0:1788482956.434836:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482956.435904:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482956.435992:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025280 00000100:00100000:1.0:1788482956.435999:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025280 00000100:00100000:1.0:1788482956.436064:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 100 00000100:00100000:1.0:1788482956.436073:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087025280:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482956.436161:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087025280:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482956.436168:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 100 00000100:00080000:3.0:1788482956.436373:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788482956.536382:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482956.536699:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098628352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788482956.536765:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482956.536951:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628352 00000100:00100000:1.0:1788482956.536959:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628352 00000100:00100000:1.0:1788482956.537009:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788482956.537018:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098628352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788482956.537299:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788482956.537389:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098628352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 371us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482956.537407:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788482956.537484:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098628352:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788482957.432506:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482957.564580:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098628736:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.564650:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482957.564700:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098629248:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.564741:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482957.564762:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098629760:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.564785:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482957.564809:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788482957.564815:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098628864:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.564836:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482957.564859:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098629376:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.564894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482957.564917:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098629888:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.564936:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482957.564969:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628736 00000100:00100000:3.0:1788482957.564976:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628736 00000100:00100000:3.0:1788482957.565019:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788482957.565028:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098628736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.565081:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098628736:12345-0@lo:400:kworker.0 Request processed in 54us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.565089:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788482957.565141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098629248 00000100:00100000:3.0:1788482957.565145:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098629248 00000100:00100000:3.0:1788482957.565178:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098629760 00000100:00100000:3.0:1788482957.565181:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098629760 00000100:00100000:3.0:1788482957.565193:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628864 00000100:00100000:3.0:1788482957.565195:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628864 00000100:00100000:3.0:1788482957.565209:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788482957.565214:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098629248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.565245:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098629248:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.565251:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788482957.565264:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788482957.565269:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098629760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.565295:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098629760:12345-0@lo:400:kworker.0 Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.565301:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788482957.565313:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788482957.565326:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098628864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.565355:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098628864:12345-0@lo:400:kworker.0 Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.565361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788482957.565385:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098629376 00000100:00100000:3.0:1788482957.565388:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098629376 00000100:00100000:3.0:1788482957.565424:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098629888 00000100:00100000:3.0:1788482957.565427:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098629888 00000100:00100000:3.0:1788482957.565445:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788482957.565452:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098629376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.565482:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098629376:12345-0@lo:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.565488:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788482957.565500:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788482957.565506:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098629888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.565532:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098629888:12345-0@lo:400:kworker.0 Request processed in 27us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.565537:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788482957.565558:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482957.565562:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482957.565564:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788482957.565598:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098628864:0@lo:400:kworker.0 00010000:00080000:3.0:1788482957.565612:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca7b80 x1875360098629376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482957.565622:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098629376:0@lo:400:kworker.0 00010000:00080000:3.0:1788482957.565632:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ecc26680 x1875360098629888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482957.565646:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098629888:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.565658:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098628736:0@lo:400:kworker.0 00010000:00080000:3.0:1788482957.565665:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f38000 x1875360098629248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482957.565672:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098629248:0@lo:400:kworker.0 00010000:00080000:3.0:1788482957.565679:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ecc24e00 x1875360098629760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482957.565686:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098629760:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.566887:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098628480:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.566939:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.566986:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098628992:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.567008:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.567027:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098629504:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.567046:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.567071:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098630016:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.567090:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.567120:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788482957.567125:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098628608:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.567145:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.567158:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098629120:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.567174:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.567185:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098629632:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.567199:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.567222:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628992 00000100:00100000:1.0:1788482957.567228:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628992 00000100:00100000:1.0:1788482957.567258:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788482957.567265:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098628992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.567306:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098628992:12345-0@lo:400:kworker.0 Request processed in 42us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482957.567313:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788482957.567345:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098628992:0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.571917:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628480 00000100:00100000:3.0:1788482957.571933:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628480 00000100:00100000:3.0:1788482957.572006:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788482957.572017:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098628480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.572142:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098628480:12345-0@lo:400:kworker.0 Request processed in 126us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.572149:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788482957.572187:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098628608 00000100:00100000:3.0:1788482957.572191:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098628608 00000100:00100000:3.0:1788482957.572214:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098629120 00000100:00100000:3.0:1788482957.572216:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098629120 00000100:00100000:3.0:1788482957.572234:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098629632 00000100:00100000:3.0:1788482957.572236:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098629632 00000100:00100000:3.0:1788482957.572248:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788482957.572253:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098628608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.572283:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098628608:12345-0@lo:400:kworker.0 Request processed in 29us (5137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.572301:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788482957.572312:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788482957.572317:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098629120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.572346:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098629120:12345-0@lo:400:kworker.0 Request processed in 29us (5171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.572352:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788482957.572361:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788482957.572366:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098629632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.572402:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098629632:12345-0@lo:400:kworker.0 Request processed in 25us (5190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.572408:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788482957.572433:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098629504 00000100:00100000:3.0:1788482957.572436:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098629504 00000100:00100000:3.0:1788482957.572458:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630016 00000100:00100000:3.0:1788482957.572460:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630016 00000100:00100000:3.0:1788482957.572475:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788482957.572480:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098629504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.572507:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098629504:12345-0@lo:400:kworker.0 Request processed in 27us (5460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.572512:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788482957.572522:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788482957.572527:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098630016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482957.572553:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098630016:12345-0@lo:400:kworker.0 Request processed in 26us (5463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.572558:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788482957.572585:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482957.572588:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482957.572590:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482957.572701:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098628608:0@lo:400:kworker.0 00000100:00100000:0.0:1788482957.572713:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098629120:0@lo:400:kworker.0 00000100:00100000:0.0:1788482957.572722:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098629632:0@lo:400:kworker.0 00000100:00100000:0.0:1788482957.572744:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098628480:0@lo:400:kworker.0 00010000:00080000:0.0:1788482957.572755:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca7800 x1875360098629504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482957.572765:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098629504:0@lo:400:kworker.0 00010000:00080000:0.0:1788482957.572774:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376e680 x1875360098630016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482957.572781:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098630016:0@lo:400:kworker.0 00000100:00100000:1.0:1788482957.575457:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482957.575481:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098630144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482957.575545:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482957.575595:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630144 00000100:00100000:1.0:1788482957.575601:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630144 00000100:00100000:1.0:1788482957.575647:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788482957.575655:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098630144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482957.575682:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482957.575736:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098630144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482957.575751:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788482957.575794:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3735c00 x1875360098630144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482957.575811:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098630144:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788482957.601498:0:11294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00000100:00100000:3.0:1788482958.072768:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098630272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788482958.072849:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482958.072964:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630272 00000100:00100000:1.0:1788482958.072972:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630272 00000100:00100000:1.0:1788482958.073024:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788482958.073033:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098630272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482958.073055:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482958.073123:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098630272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482958.073131:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788482958.073171:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87480 x1875360098630272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482958.073188:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098630272:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788482958.457108:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482959.103086:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482959.103121:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098630400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482959.103190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482959.103249:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630400 00000100:00100000:1.0:1788482959.103257:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630400 00000100:00100000:1.0:1788482959.103301:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788482959.103310:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098630400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788482959.103342:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788482959.105288:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788482959.105307:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098630528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482959.105352:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482959.105932:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098630400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2619us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482959.105947:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788482959.105984:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630528 00000100:00100000:1.0:1788482959.105991:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630528 00000100:00100000:1.0:1788482959.106034:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788482959.106041:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098630528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482959.106067:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482959.106127:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098630528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482959.106133:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788482959.106148:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788482959.106178:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73faa00 x1875360098630528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482959.106196:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098630528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482959.106230:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098630400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788482959.108354:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482959.108374:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098630656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788482959.108440:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482959.118633:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630656 00000100:00100000:0.0:1788482959.118647:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630656 00000100:00100000:0.0:1788482959.118730:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788482959.118742:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098630656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788482959.118764:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788482959.118834:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482959.118844:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098630656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (10404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482959.118851:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788482959.118898:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755880 x1875360098630656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482959.118918:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098630656:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788482959.124765:0:11342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 20:49:16 EDT 2026 00010000:00010000:2.0:1788482959.481431:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482960.505613:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482961.529215:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482961.554434:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482961.554484:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482961.554532:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025664 00000100:00100000:1.0:1788482961.554542:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025664 00000100:00100000:1.0:1788482961.554603:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 107 00000100:00100000:1.0:1788482961.554613:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087025664:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482961.554681:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087025664:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482961.554702:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 107 00000100:00080000:1.0:1788482961.554725:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788482961.558254:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025408 00000100:00100000:3.0:1788482961.558270:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025408 00000100:00100000:3.0:1788482961.558340:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 285 00000100:00100000:3.0:1788482961.558362:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2392:x1875360087025408:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482961.558455:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2392:x1875360087025408:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 94us (4029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482961.558464:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 285 00000100:00100000:1.0:1788482961.570036:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482961.570139:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025536 00000100:00100000:3.0:1788482961.570150:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025536 00000100:00100000:3.0:1788482961.570218:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 108 00000100:00100000:3.0:1788482961.570229:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087025536:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482961.570304:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087025536:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482961.570311:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 108 00000100:00080000:1.0:1788482961.570683:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482961.656232:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482961.656255:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098630784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788482961.656323:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482961.657982:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630784 00000100:00100000:3.0:1788482961.657994:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630784 00000100:00100000:3.0:1788482961.658054:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788482961.658063:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098630784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788482961.658113:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482961.658185:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098630784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482961.658191:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788482961.658236:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098630784:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788482962.552471:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482962.682635:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482962.683422:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098631040:0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.683492:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482962.683555:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482962.683562:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098631168:0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.683588:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482962.683645:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631040 00000100:00100000:3.0:1788482962.683651:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631040 00000100:00100000:3.0:1788482962.683699:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788482962.683707:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098631040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.683765:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098631040:12345-0@lo:400:kworker.0 Request processed in 58us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.683773:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788482962.683814:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098631040:0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.683848:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631168 00000100:00100000:3.0:1788482962.683852:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631168 00000100:00100000:3.0:1788482962.683877:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788482962.683883:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098631168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.683916:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098631168:12345-0@lo:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.683939:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788482962.683963:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098631424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482962.683991:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482962.684016:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788482962.684022:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098631296:0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.684043:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482962.684067:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631424 00000100:00100000:3.0:1788482962.684070:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631424 00000100:00100000:3.0:1788482962.684123:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788482962.684130:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098631424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482962.684153:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482962.684188:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098631424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.684194:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788482962.684223:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631296 00000100:00100000:3.0:1788482962.684227:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631296 00000100:00100000:3.0:1788482962.684248:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788482962.684254:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098631296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.684283:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098631296:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.684288:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788482962.684316:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098631296:0@lo:400:kworker.0 00010000:00080000:3.0:1788482962.684327:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755880 x1875360098631424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482962.684340:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098631424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482962.684387:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098631168:0@lo:400:kworker.0 00000100:00080000:3.0:1788482962.684420:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788482962.692410:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098630912:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.692509:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.694143:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482962.694160:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098631808:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694240:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.694282:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631808 00000100:00100000:2.0:1788482962.694290:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631808 00000100:00100000:2.0:1788482962.694341:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788482962.694349:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098631808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694407:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098631808:12345-0@lo:400:kworker.0 Request processed in 59us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482962.694414:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1788482962.694434:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788482962.694462:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb84380 x1875360098631808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482962.694476:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098631808:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694513:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098631680:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694538:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.694559:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788482962.694564:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098631552:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694590:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.694614:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631680 00000100:00100000:2.0:1788482962.694617:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631680 00000100:00100000:2.0:1788482962.694644:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788482962.694651:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098631680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694681:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098631680:12345-0@lo:400:kworker.0 Request processed in 31us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482962.694702:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788482962.694717:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482962.694735:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098631680:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694762:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631552 00000100:00100000:2.0:1788482962.694766:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631552 00000100:00100000:2.0:1788482962.694804:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788482962.694812:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.694849:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098631552:12345-0@lo:400:kworker.0 Request processed in 38us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482962.694854:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788482962.694880:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098631552:0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.697134:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098630912 00000100:00100000:3.0:1788482962.697153:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098630912 00000100:00100000:3.0:1788482962.697231:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788482962.697243:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098630912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482962.706546:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482962.706568:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098632064:0@lo:400:kworker.0 00000100:00100000:1.0:1788482962.706639:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482962.706708:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098632192:0@lo:400:kworker.0 00000100:00100000:1.0:1788482962.706735:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482962.706764:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632192 00000100:00100000:1.0:1788482962.706770:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632192 00000100:00100000:1.0:1788482962.706839:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788482962.706848:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098632192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482962.706897:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098632192:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482962.706904:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788482962.706927:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482962.706958:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098632192:0@lo:400:kworker.0 00000100:00100000:1.0:1788482962.707058:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632064 00000100:00100000:1.0:1788482962.707062:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632064 00000100:00100000:1.0:1788482962.707092:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788482962.707124:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098632064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482962.707159:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098632064:12345-0@lo:400:kworker.0 Request processed in 37us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482962.707165:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788482962.707180:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788482962.707421:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb85500 x1875360098632064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482962.707432:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098632064:0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.708408:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098630912:12345-0@lo:400:kworker.0 Request processed in 11163us (15896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.708420:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788482962.708919:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098631936:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.708969:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.709006:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098632448:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.709029:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.709061:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482962.709068:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098632320:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.709090:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.709142:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632320 00000100:00100000:2.0:1788482962.709148:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632320 00000100:00100000:3.0:1788482962.709426:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098631936 00000100:00100000:3.0:1788482962.709431:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098631936 00000100:00100000:3.0:1788482962.709460:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632448 00000100:00100000:3.0:1788482962.709463:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632448 00000100:00100000:3.0:1788482962.709479:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788482962.709486:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098631936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.709537:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098631936:12345-0@lo:400:kworker.0 Request processed in 51us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.709544:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788482962.709557:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788482962.709563:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098632448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482962.709590:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098632448:12345-0@lo:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.709595:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788482962.709708:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87800 x1875360098631936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482962.709721:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098631936:0@lo:400:kworker.0 00010000:00080000:1.0:1788482962.709731:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22d80 x1875360098632448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482962.709739:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098632448:0@lo:400:kworker.0 00000100:00080000:1.0:1788482962.709769:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482962.709773:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482962.709776:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788482962.710179:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788482962.710193:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098632320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.710268:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098632320:12345-0@lo:400:kworker.0 Request processed in 79us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482962.710489:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098630912:0@lo:400:kworker.0 00010000:00080000:1.0:1788482962.710668:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb84380 x1875360098632320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482962.710679:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098632320:0@lo:400:kworker.0 00000100:00100000:2.0:1788482962.717430:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788482963.192945:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482963.192968:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098632576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788482963.193033:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482963.193090:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632576 00000100:00100000:1.0:1788482963.193117:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632576 00000100:00100000:1.0:1788482963.193158:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788482963.193166:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098632576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482963.193185:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482963.193221:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098632576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.193240:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788482963.193279:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22d80 x1875360098632576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482963.193297:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098632576:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788482963.576942:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482964.216385:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482964.216407:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098632704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788482964.216496:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482964.216569:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632704 00000100:00100000:0.0:1788482964.216577:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632704 00000100:00100000:0.0:1788482964.216628:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788482964.216638:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098632704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788482964.216664:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482964.216708:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098632704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482964.216715:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788482964.216736:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482964.216766:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755880 x1875360098632704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482964.216784:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098632704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482964.217220:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098632832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482964.217262:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482964.217375:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632832 00000100:00100000:3.0:1788482964.217381:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632832 00000100:00100000:3.0:1788482964.217418:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788482964.217427:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098632832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788482964.217457:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482964.217510:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098632832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482964.217517:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788482964.217809:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098632832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788482964.218403:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482964.218415:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098632960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482964.218455:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482964.218676:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098632960 00000100:00100000:0.0:1788482964.218685:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098632960 00000100:00100000:0.0:1788482964.218763:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788482964.218775:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098632960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482964.218795:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482964.218858:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098632960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482964.218866:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788482964.218914:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755880 x1875360098632960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482964.218930:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098632960:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788482964.219599:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788482964.600276:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482965.626547:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482966.652566:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482966.672693:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482966.672737:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482966.672828:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482966.672856:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025920 00000100:00100000:2.0:1788482966.672874:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025920 00000100:00100000:2.0:1788482966.672922:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026048 00000100:00100000:2.0:1788482966.672924:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026048 00000100:00100000:2.0:1788482966.672942:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 115 00000100:00100000:2.0:1788482966.672951:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087025920:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482966.673015:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087025920:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 65us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482966.673022:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 115 00000100:00100000:2.0:1788482966.673037:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 116 00000100:00100000:2.0:1788482966.673044:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087026048:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788482966.673066:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087026048:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482966.673072:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 116 00000100:00080000:2.0:1788482966.673087:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788482966.673091:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482966.673543:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087025792 00000100:00100000:3.0:1788482966.673548:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087025792 00000100:00100000:3.0:1788482966.673595:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 287 00000100:00100000:3.0:1788482966.673603:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087025792:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482966.673633:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087025792:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 33us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482966.673640:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 287 00000100:00100000:2.0:1788482966.776486:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788482966.776509:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098633088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788482966.776593:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482966.776867:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633088 00000100:00100000:3.0:1788482966.776874:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633088 00000100:00100000:3.0:1788482966.776926:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788482966.776936:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098633088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788482966.776967:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482966.777019:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098633088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482966.777026:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788482966.777130:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098633088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788482967.672463:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482967.801440:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098633472:0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.801519:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482967.801572:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098633984:0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.801596:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482967.801612:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098634496:0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.801633:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482967.801653:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788482967.801659:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098633344:0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.801678:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482967.801698:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098633856:0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.801716:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482967.801751:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098634368:0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.801788:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482967.801813:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633472 00000100:00100000:0.0:1788482967.801819:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633472 00000100:00100000:0.0:1788482967.801866:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788482967.801874:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098633472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.801932:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098633472:12345-0@lo:400:kworker.0 Request processed in 58us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482967.801938:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788482967.801961:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633984 00000100:00100000:0.0:1788482967.801964:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633984 00000100:00100000:0.0:1788482967.801989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098634496 00000100:00100000:0.0:1788482967.801992:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098634496 00000100:00100000:0.0:1788482967.802004:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633344 00000100:00100000:0.0:1788482967.802006:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633344 00000100:00100000:0.0:1788482967.802016:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633856 00000100:00100000:0.0:1788482967.802017:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633856 00000100:00100000:0.0:1788482967.802028:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098634368 00000100:00100000:0.0:1788482967.802030:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098634368 00000100:00100000:0.0:1788482967.802048:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788482967.802054:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482967.802086:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098633984:12345-0@lo:400:kworker.0 Request processed in 32us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482967.802093:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788482967.802282:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098633216:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.802312:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482967.802350:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098633728:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.802371:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482967.802389:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098634240:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.802407:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482967.802420:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098634752:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.802434:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482967.802449:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788482967.802463:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098633600:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.802482:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482967.802491:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098634112:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.802505:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482967.802518:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098634624:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.802532:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482967.802553:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633600 00000100:00100000:2.0:1788482967.802556:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633600 00000100:00100000:3.0:1788482967.802671:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633216 00000100:00100000:3.0:1788482967.802675:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633216 00000100:00100000:3.0:1788482967.802701:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788482967.802707:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098633216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482967.802741:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098633216:12345-0@lo:400:kworker.0 Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482967.802747:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788482967.803702:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098634240 00000100:00100000:3.0:1788482967.803709:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098634240 00000100:00100000:3.0:1788482967.803745:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098634752 00000100:00100000:3.0:1788482967.803747:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098634752 00000100:00100000:3.0:1788482967.803758:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098634112 00000100:00100000:3.0:1788482967.803760:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098634112 00000100:00100000:3.0:1788482967.803770:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098634624 00000100:00100000:3.0:1788482967.803772:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098634624 00000100:00100000:3.0:1788482967.803785:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788482967.803791:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098634240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482967.803832:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098634240:12345-0@lo:400:kworker.0 Request processed in 41us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482967.803838:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788482967.803848:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788482967.803853:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098634752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482967.803872:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098634752:12345-0@lo:400:kworker.0 Request processed in 20us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482967.803877:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788482967.803885:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788482967.803890:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098634112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482967.803907:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098634112:12345-0@lo:400:kworker.0 Request processed in 18us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482967.803912:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788482967.803919:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788482967.803924:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098634624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482967.803942:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098634624:12345-0@lo:400:kworker.0 Request processed in 18us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482967.803958:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788482967.803973:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098633728 00000100:00100000:3.0:1788482967.803976:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098633728 00000100:00100000:3.0:1788482967.804039:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788482967.804047:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098633728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482967.804079:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098633728:12345-0@lo:400:kworker.0 Request processed in 33us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482967.804085:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788482967.804253:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788482967.804262:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098634496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.804295:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098634496:12345-0@lo:400:kworker.0 Request processed in 35us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482967.804301:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788482967.804332:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788482967.804348:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098633344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.804378:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098633344:12345-0@lo:400:kworker.0 Request processed in 40us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482967.804384:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788482967.804394:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788482967.804400:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098633856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.804424:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098633856:12345-0@lo:400:kworker.0 Request processed in 25us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482967.804430:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788482967.804440:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788482967.804447:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098634368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.807776:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098634368:12345-0@lo:400:kworker.0 Request processed in 3320us (5978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482967.807791:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788482967.807824:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788482967.807834:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098633600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.807874:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098633600:12345-0@lo:400:kworker.0 Request processed in 44us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482967.807880:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788482967.808034:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098633600:0@lo:400:kworker.0 00010000:00080000:2.0:1788482967.808051:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3768e00 x1875360098634112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482967.808062:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098634112:0@lo:400:kworker.0 00010000:00080000:2.0:1788482967.808088:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769500 x1875360098634624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482967.808124:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098634624:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.808137:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098633216:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.808149:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098633728:0@lo:400:kworker.0 00010000:00080000:2.0:1788482967.808159:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769180 x1875360098634240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482967.808167:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098634240:0@lo:400:kworker.0 00010000:00080000:2.0:1788482967.808178:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376b800 x1875360098634752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482967.808185:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098634752:0@lo:400:kworker.0 00000100:00080000:2.0:1788482967.808447:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788482967.808454:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482967.808523:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788482967.808528:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788482967.808759:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098633344:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.808771:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098633856:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.808781:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098634368:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.808791:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098633472:0@lo:400:kworker.0 00010000:00080000:2.0:1788482967.808803:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376ad80 x1875360098633984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482967.808812:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098633984:0@lo:400:kworker.0 00010000:00080000:2.0:1788482967.808833:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769880 x1875360098634496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482967.808842:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098634496:0@lo:400:kworker.0 00000100:00100000:2.0:1788482967.809276:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482967.809289:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098634880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482967.809469:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482967.809605:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098634880 00000100:00100000:1.0:1788482967.809613:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098634880 00000100:00100000:1.0:1788482967.809665:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788482967.809674:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098634880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482967.809701:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482967.809761:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098634880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482967.809767:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788482967.809798:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20000 x1875360098634880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482967.809815:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098634880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482968.312719:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482968.312742:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098635008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788482968.312816:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482968.314490:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635008 00000100:00100000:1.0:1788482968.314500:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635008 00000100:00100000:1.0:1788482968.314643:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788482968.314653:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098635008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482968.314689:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482968.314764:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098635008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482968.314770:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788482968.314888:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20000 x1875360098635008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482968.314907:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098635008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788482968.698402:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482969.337344:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098635136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788482969.337387:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098635264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788482969.337389:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098635392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482969.337425:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482969.337425:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482969.338322:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635136 00000100:00100000:0.0:1788482969.338342:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635136 00000100:00100000:0.0:1788482969.338435:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788482969.338445:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098635136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788482969.338535:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788482969.338605:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482969.338607:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635264 00000100:00100000:2.0:1788482969.338612:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635264 00000100:00100000:2.0:1788482969.338647:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788482969.338654:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098635264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788482969.338676:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482969.346054:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482969.347727:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098635136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9277us (10295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482969.347741:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788482969.347771:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635392 00000100:00100000:0.0:1788482969.347778:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635392 00000100:00080000:3.0:1788482969.347978:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482969.348134:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098635264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9478us (10707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482969.348144:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788482969.348456:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098635264:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788482969.349742:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21180 x1875360098635136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482969.349763:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098635136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788482969.351354:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788482969.351373:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098635392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482969.351398:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482969.351487:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098635392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482969.351495:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788482969.351549:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3cc5c00 x1875360098635392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482969.351570:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098635392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788482969.723040:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482970.747147:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482971.768268:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482971.789196:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482971.789234:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482971.789266:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482971.789297:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026304 00000100:00100000:2.0:1788482971.789309:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026304 00000100:00100000:2.0:1788482971.789395:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026432 00000100:00100000:2.0:1788482971.789400:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026432 00000100:00100000:2.0:1788482971.789427:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:2.0:1788482971.789440:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087026304:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482971.789454:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026176 00000100:00100000:1.0:1788482971.789459:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026176 00000100:00100000:1.0:1788482971.789564:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 289 00000100:00100000:1.0:1788482971.789573:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2391:x1875360087026176:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482971.789652:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+10:2391:x1875360087026176:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 80us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482971.789660:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 289 00000100:00100000:0.0:1788482971.790089:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 124 00000100:00100000:0.0:1788482971.790122:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087026432:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482971.790157:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087026432:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 61us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482971.790164:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 124 00000100:00100000:2.0:1788482971.791821:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087026304:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 2270us (2523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482971.791835:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00080000:0.0:1788482971.792221:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788482971.792228:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482971.896526:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098635520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788482971.896634:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482971.896829:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635520 00000100:00100000:3.0:1788482971.896839:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635520 00000100:00100000:3.0:1788482971.896915:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788482971.896928:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098635520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788482971.896981:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482971.897053:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098635520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482971.897083:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788482971.897174:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098635520:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788482972.799769:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482972.920284:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482972.920329:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098635648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482972.920426:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482972.923794:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635648 00000100:00100000:1.0:1788482972.923817:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635648 00000100:00100000:1.0:1788482972.923915:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788482972.923932:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098635648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482972.923975:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482972.924087:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098635648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.924114:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788482972.924182:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f23480 x1875360098635648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482972.924225:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098635648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482972.924325:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098635776:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.924370:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788482972.924460:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482972.931780:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098636160:0@lo:400:kworker.0 00000100:00100000:0.0:1788482972.931878:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482972.931971:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098635904:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.932005:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482972.932060:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098636032:0@lo:400:kworker.0 00000100:00100000:3.0:1788482972.932117:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482972.938807:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635776 00000100:00100000:1.0:1788482972.938828:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635776 00000100:00100000:1.0:1788482972.938911:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788482972.938923:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098635776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.939046:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098635776:12345-0@lo:400:kworker.0 Request processed in 124us (14674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.939055:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788482972.939153:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098635776:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.943816:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098636288:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.943914:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482972.944005:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636032 00000100:00100000:1.0:1788482972.944017:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636032 00000100:00100000:1.0:1788482972.944083:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636288 00000100:00100000:1.0:1788482972.944087:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636288 00000100:00100000:1.0:1788482972.944129:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788482972.944139:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098636032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944202:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098636032:12345-0@lo:400:kworker.0 Request processed in 63us (12083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.944210:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788482972.944230:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788482972.944236:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098636288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944289:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098636288:12345-0@lo:400:kworker.0 Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.944296:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788482972.944346:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098636288:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944404:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482972.944412:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098636672:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944440:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482972.944468:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636672 00000100:00100000:1.0:1788482972.944472:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636672 00000100:00100000:1.0:1788482972.944529:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788482972.944536:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098636672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944568:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098636672:12345-0@lo:400:kworker.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.944574:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788482972.944594:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788482972.944614:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22680 x1875360098636672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482972.944626:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098636672:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944656:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098636800:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944679:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482972.944706:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636800 00000100:00100000:1.0:1788482972.944710:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636800 00000100:00100000:1.0:1788482972.944739:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788482972.944746:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098636800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944779:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098636800:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.944793:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788482972.944811:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788482972.944828:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22680 x1875360098636800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482972.944837:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098636800:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944876:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482972.944883:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098637184:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944906:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482972.944927:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637184 00000100:00100000:1.0:1788482972.944931:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637184 00000100:00100000:1.0:1788482972.944957:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788482972.944963:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098637184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.944996:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098637184:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.945001:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788482972.945016:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788482972.945031:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21f80 x1875360098637184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482972.945040:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098637184:0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.945233:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636160 00000100:00100000:1.0:1788482972.945239:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636160 00000100:00100000:1.0:1788482972.945268:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098635904 00000100:00100000:1.0:1788482972.945271:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098635904 00000100:00100000:1.0:1788482972.945295:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788482972.945301:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098636160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.945348:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098636160:12345-0@lo:400:kworker.0 Request processed in 47us (13472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.945362:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788482972.945375:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788482972.945381:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098635904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482972.945412:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098635904:12345-0@lo:400:kworker.0 Request processed in 31us (13407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482972.945417:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788482972.950091:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098636160:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950305:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098635904:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950344:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098636416:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950428:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482972.950472:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098636928:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950509:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482972.950531:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788482972.950538:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098636544:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950560:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482972.950576:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098637056:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950598:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482972.950633:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636416 00000100:00100000:2.0:1788482972.950641:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636416 00000100:00100000:2.0:1788482972.950697:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636928 00000100:00100000:2.0:1788482972.950700:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636928 00000100:00100000:2.0:1788482972.950712:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098636544 00000100:00100000:2.0:1788482972.950714:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098636544 00000100:00100000:2.0:1788482972.950737:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637056 00000100:00100000:2.0:1788482972.950756:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637056 00000100:00100000:2.0:1788482972.950776:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788482972.950786:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098636416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950843:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098636416:12345-0@lo:400:kworker.0 Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482972.950850:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788482972.950867:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788482972.950872:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098636928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950897:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098636928:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482972.950902:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788482972.950911:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788482972.950917:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098636544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950939:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098636544:12345-0@lo:400:kworker.0 Request processed in 23us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482972.950944:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788482972.950953:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788482972.950958:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098637056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.950982:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098637056:12345-0@lo:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482972.950987:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:2.0:1788482972.951015:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21880 x1875360098637056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482972.951029:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098637056:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.951039:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098636416:0@lo:400:kworker.0 00000100:00100000:2.0:1788482972.951060:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098636928:0@lo:400:kworker.0 00010000:00080000:2.0:1788482972.951081:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f23b80 x1875360098636544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482972.951089:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098636544:0@lo:400:kworker.0 00000100:00080000:1.0:1788482972.951355:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788482972.951361:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482972.963969:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098636032:0@lo:400:kworker.0 00000100:00100000:2.0:1788482973.435611:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098637312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788482973.435720:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482973.436237:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637312 00000100:00100000:1.0:1788482973.436249:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637312 00000100:00100000:1.0:1788482973.436336:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788482973.436349:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098637312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482973.436382:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482973.436467:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098637312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482973.436475:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788482973.436619:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21f80 x1875360098637312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482973.436641:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098637312:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788482973.819569:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482974.456346:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098637440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788482974.456622:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482974.456720:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637440 00000100:00100000:3.0:1788482974.456730:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637440 00000100:00100000:3.0:1788482974.456861:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788482974.456872:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4764050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098637440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788482974.456915:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788482974.456971:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4764050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098637440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482974.456978:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788482974.457844:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098637440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788482974.457868:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482974.457877:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098637568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482974.457923:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482974.458137:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637568 00000100:00100000:1.0:1788482974.458143:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637568 00000100:00100000:1.0:1788482974.458199:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788482974.458208:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098637568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482974.458236:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482974.463404:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482974.463436:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098637696:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788482974.464052:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482974.464578:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f4000 x1875360098637568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482974.464608:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098637568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482974.468040:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482974.469412:0:8413:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788482974.469424:0:8413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788482974.470416:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637696 00000100:00100000:3.0:1788482974.470428:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637696 00000100:00100000:3.0:1788482974.470770:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788482974.470784:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098637696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788482974.470867:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482974.470938:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098637696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482974.470944:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788482974.470981:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20700 x1875360098637696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482974.471001:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098637696:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788482974.473317:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482974.473583:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098637568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15367us (15650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482974.473599:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:1.0:1788482974.840386:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788482975.214039:0:11972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:49:32 (1788482972) === 00000100:00100000:1.0:1788482975.793634:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482975.793827:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026560 00000100:00100000:3.0:1788482975.793840:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026560 00000100:00100000:3.0:1788482975.793911:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 291 00000100:00100000:3.0:1788482975.793924:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+10:8721:x1875360087026560:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788482975.793945:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482975.793969:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77400/0x1d7ea3d89ea1a648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e165 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482975.794010:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77400/0x1d7ea3d89ea1a648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e165 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482975.794024:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f77400/0x1d7ea3d89ea1a648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e165 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482975.794035:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77400, rc 0) 00000100:00100000:3.0:1788482975.794202:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+11:8721:x1875360087026560:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 280us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482975.794229:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 291 00000100:00100000:0.0:1788482975.812472:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.813584:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026688 00000100:00100000:1.0:1788482975.813604:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026688 00000100:00100000:1.0:1788482975.813688:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 292 00000100:00100000:1.0:1788482975.813701:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+11:8721:x1875360087026688:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788482975.813926:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+11:8721:x1875360087026688:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 227us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.813935:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 292 00000100:00100000:2.0:1788482975.816806:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.817142:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026816 00000100:00100000:1.0:1788482975.817157:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026816 00000100:00100000:1.0:1788482975.817382:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 293 00000100:00100000:1.0:1788482975.817394:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+11:8721:x1875360087026816:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788482975.817844:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+11:8721:x1875360087026816:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 450us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.817854:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 293 00000100:00100000:1.0:1788482975.831411:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482975.833464:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087026944 00000100:00100000:2.0:1788482975.833488:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087026944 00000100:00100000:2.0:1788482975.833587:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 294 00000100:00100000:2.0:1788482975.833600:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+11:8725:x1875360087026944:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788482975.833850:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+11:8725:x1875360087026944:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 252us (4569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482975.833859:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 294 00010000:00010000:2.0:1788482975.865900:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482975.866777:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482975.866876:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027072 00000100:00100000:3.0:1788482975.866891:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027072 00000100:00100000:3.0:1788482975.866976:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 295 00000100:00100000:3.0:1788482975.866988:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+11:8725:x1875360087027072:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788482975.867237:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+11:8725:x1875360087027072:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 249us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482975.867247:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 295 00000100:00100000:3.0:1788482975.880307:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.881078:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027200 00000100:00100000:1.0:1788482975.881126:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027200 00000100:00100000:1.0:1788482975.881213:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 296 00000100:00100000:1.0:1788482975.881226:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+11:8725:x1875360087027200:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482975.881811:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+11:8725:x1875360087027200:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 583us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.881823:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 296 00000100:00100000:0.0:1788482975.884657:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482975.888496:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027328 00000100:00100000:2.0:1788482975.888518:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027328 00000100:00100000:2.0:1788482975.888609:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 297 00000100:00100000:2.0:1788482975.888622:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+11:8721:x1875360087027328:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788482975.888644:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482975.888668:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a64f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e196 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482975.888705:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e196 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482975.888738:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e196 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482975.888749:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1200, rc 0) 00000100:00100000:2.0:1788482975.888897:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:8721:x1875360087027328:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 277us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482975.888905:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 297 00000100:00100000:0.0:1788482975.896903:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.898648:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027456 00000100:00100000:1.0:1788482975.898671:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027456 00000100:00100000:1.0:1788482975.898952:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 298 00000100:00100000:1.0:1788482975.898966:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+12:8721:x1875360087027456:12345-192.168.206.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788482975.899001:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788482975.899024:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788482975.899029:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788482975.899032:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788482975.899035:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788482975.899038:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788482975.904495:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+12:8721:x1875360087027456:12345-192.168.206.54@tcp:256:mount.lustre.0 Request processed in 5515us (7590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.904514:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 298 00000100:00100000:0.0:1788482975.908805:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482975.909009:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027584 00000100:00100000:3.0:1788482975.909144:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027584 00000100:00100000:3.0:1788482975.909224:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 299 00000100:00100000:3.0:1788482975.909237:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+12:8721:x1875360087027584:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788482975.909261:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482975.909289:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e19d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482975.909340:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482975.909352:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482975.909363:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76600, rc 0) 00000100:00100000:3.0:1788482975.909439:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:8721:x1875360087027584:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 204us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482975.909478:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 299 00000100:00100000:0.0:1788482975.920459:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.920736:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027712 00000100:00100000:1.0:1788482975.920749:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027712 00000100:00100000:1.0:1788482975.920887:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 300 00000100:00100000:1.0:1788482975.920900:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:8721:x1875360087027712:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788482975.921153:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:8721:x1875360087027712:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 255us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.921163:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 300 00000100:00100000:0.0:1788482975.923501:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482975.923762:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027840 00000100:00100000:3.0:1788482975.923774:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027840 00000100:00100000:3.0:1788482975.923841:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 301 00000100:00100000:3.0:1788482975.923855:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:8721:x1875360087027840:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788482975.924034:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:8721:x1875360087027840:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 183us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482975.924043:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 301 00000100:00100000:0.0:1788482975.933150:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.933346:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087027968 00000100:00100000:1.0:1788482975.933360:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087027968 00000100:00100000:1.0:1788482975.933581:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 302 00000100:00100000:1.0:1788482975.933594:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:8728:x1875360087027968:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482975.933811:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:8728:x1875360087027968:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 219us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.933896:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 302 00000100:00100000:0.0:1788482975.938150:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482975.938325:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028096 00000100:00100000:3.0:1788482975.938340:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028096 00000100:00100000:3.0:1788482975.938426:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 303 00000100:00100000:3.0:1788482975.938439:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:8728:x1875360087028096:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788482975.938626:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:8728:x1875360087028096:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 188us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482975.938635:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 303 00000100:00100000:0.0:1788482975.946312:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482975.946367:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482975.946397:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482975.946476:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482975.946517:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028224 00000100:00100000:0.0:1788482975.946530:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028224 00000100:00100000:0.0:1788482975.946566:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028480 00000100:00100000:0.0:1788482975.946569:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028480 00000100:00100000:0.0:1788482975.946575:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028864 00000100:00100000:0.0:1788482975.946577:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028864 00000100:00100000:0.0:1788482975.946612:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028992 00000100:00100000:0.0:1788482975.946614:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028992 00000100:00100000:0.0:1788482975.946636:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:0.0:1788482975.946648:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087028864:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482975.946741:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087028864:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482975.946749:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:0.0:1788482975.946768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:0.0:1788482975.946774:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087028992:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482975.946799:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087028992:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482975.946805:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:0.0:1788482975.946816:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:0.0:1788482975.946821:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875360087028224:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788482975.946848:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce@192.168.206.54@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1788482975.946887:0:6494:0:(genops.c:1385:class_connect()) connect: client 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce, cookie 0x1d7ea3d89ea1a65d 00000004:00100000:0.0:1788482975.946918:0:6494:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788482975.947065:0:6494:0:(import.c:65:import_set_state_nolock()) ffff9a69efd92800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482975.947152:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2389:x1875360087028224:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 328us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482975.947169:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:0.0:1788482975.947184:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:0.0:1788482975.947188:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875360087028480:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788482975.947205:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce@192.168.206.54@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1788482975.947230:0:6494:0:(genops.c:1385:class_connect()) connect: client 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce, cookie 0x1d7ea3d89ea1a664 00000004:00100000:0.0:1788482975.947243:0:6494:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788482975.947318:0:6494:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482975.947345:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2389:x1875360087028480:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 155us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482975.947351:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00080000:3.0:1788482975.948004:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788482975.948013:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482975.951441:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482975.951547:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482975.960834:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028608 00000100:00100000:2.0:1788482975.960855:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028608 00000100:00100000:2.0:1788482975.960969:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028352 00000100:00100000:2.0:1788482975.960974:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028352 00000100:00100000:2.0:1788482975.961012:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:2.0:1788482975.961023:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:0:x1875360087028608:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788482975.961075:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788482975.961231:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:0:x1875360087028608:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 209us (9803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482975.961240:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:2.0:1788482975.961261:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:2.0:1788482975.961280:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:0:x1875360087028352:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788482975.961309:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788482975.961352:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:0:x1875360087028352:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 84us (9803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482975.961358:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:0.0:1788482975.963348:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482975.963389:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087028736 00000100:00100000:3.0:1788482975.963401:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087028736 00000100:00100000:3.0:1788482975.963657:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788482975.963744:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087028736:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788482975.963857:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482975.964072:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087028736:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 333us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482975.964081:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00080000:3.0:1788482975.964165:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482975.964171:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788482975.966493:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.966602:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087029120 00000100:00100000:1.0:1788482975.966629:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087029120 00000100:00100000:1.0:1788482975.966701:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:1.0:1788482975.966712:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087029120:12345-192.168.206.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788482975.966828:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087029120:12345-192.168.206.54@tcp:40:mount.lustre.0 Request processed in 117us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.966837:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:0.0:1788482975.973664:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482975.973724:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482975.973761:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482975.974015:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087029248 00000100:00100000:1.0:1788482975.974029:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087029248 00000100:00100000:1.0:1788482975.974080:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087029376 00000100:00100000:1.0:1788482975.974084:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087029376 00000100:00100000:1.0:1788482975.974147:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:1.0:1788482975.974157:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875360087029248:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788482975.974203:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce@192.168.206.54@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788482975.974245:0:8411:0:(genops.c:1385:class_connect()) connect: client 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce, cookie 0x1d7ea3d89ea1a66b 00002000:00100000:1.0:1788482975.974261:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce/ffff9a68c36b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788482975.974294:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788482975.974400:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788482975.974476:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482975.974565:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2389:x1875360087029248:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 407us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.974573:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:1.0:1788482975.974595:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:1.0:1788482975.974601:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875360087029376:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788482975.974623:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce@192.168.206.54@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788482975.974644:0:8411:0:(genops.c:1385:class_connect()) connect: client 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce, cookie 0x1d7ea3d89ea1a672 00002000:00100000:1.0:1788482975.974665:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce/ffff9a68c36b4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788482975.974677:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788482975.974716:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788482975.974732:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482975.974757:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2389:x1875360087029376:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 155us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.974764:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:2.0:1788482975.975531:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087029504 00000100:00100000:2.0:1788482975.975556:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087029504 00000100:00100000:2.0:1788482975.975622:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:2.0:1788482975.975633:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087029504:12345-192.168.206.54@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788482975.975710:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087029504:12345-192.168.206.54@tcp:900:mount.lustre.0 Request processed in 80us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482975.975718:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:0.0:1788482975.978005:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788482975.978257:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087029632 00000100:00100000:2.0:1788482975.978270:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087029632 00000100:00100000:2.0:1788482975.978387:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:2.0:1788482975.978494:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087029632:12345-192.168.206.54@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788482975.978614:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788482975.978814:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:8721:x1875360087029632:12345-192.168.206.54@tcp:33:mount.lustre.0 Request processed in 415us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482975.978823:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00010000:00010000:1.0:1788482976.888351:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482977.016810:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482977.021894:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098637824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788482977.025254:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482977.025608:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637824 00000100:00100000:3.0:1788482977.025620:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637824 00000100:00100000:3.0:1788482977.025689:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788482977.025701:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098637824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788482977.025759:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482977.025845:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098637824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482977.025853:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788482977.026386:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098637824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788482977.915084:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482978.040558:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098638208:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.040652:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.040727:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098638720:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.040756:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.040777:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098639232:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.040799:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.040828:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788482978.040834:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098638336:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.040857:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.040881:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098638848:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.040908:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.040930:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098639360:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.040988:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.041041:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638720 00000100:00100000:1.0:1788482978.041052:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638720 00000100:00100000:1.0:1788482978.041153:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098639232 00000100:00100000:1.0:1788482978.041157:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098639232 00000100:00100000:1.0:1788482978.041175:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638336 00000100:00100000:1.0:1788482978.041178:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638336 00000100:00100000:1.0:1788482978.041196:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788482978.041205:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098638720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.041269:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098638720:12345-0@lo:400:kworker.0 Request processed in 65us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.041277:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788482978.041312:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788482978.041318:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098639232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.041344:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098639232:12345-0@lo:400:kworker.0 Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.041349:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788482978.041359:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788482978.041364:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098638336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.041386:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098638336:12345-0@lo:400:kworker.0 Request processed in 22us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.041391:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788482978.041416:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638848 00000100:00100000:1.0:1788482978.041420:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638848 00000100:00100000:1.0:1788482978.041444:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098639360 00000100:00100000:1.0:1788482978.041447:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098639360 00000100:00100000:1.0:1788482978.041465:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788482978.041472:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098638848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.041509:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098638848:12345-0@lo:400:kworker.0 Request processed in 37us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.041515:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788482978.041526:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788482978.041532:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098639360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.041555:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098639360:12345-0@lo:400:kworker.0 Request processed in 24us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.041561:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788482978.041579:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482978.041584:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482978.041587:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788482978.041622:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098638336:0@lo:400:kworker.0 00010000:00080000:1.0:1788482978.041638:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22680 x1875360098638848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482978.041650:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098638080:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.041653:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098638848:0@lo:400:kworker.0 00010000:00080000:1.0:1788482978.041669:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20000 x1875360098639360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482978.041679:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098639360:0@lo:400:kworker.0 00010000:00080000:1.0:1788482978.041695:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f23b80 x1875360098638720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482978.041696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.041709:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098638720:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.041725:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098638592:0@lo:400:kworker.0 00010000:00080000:1.0:1788482978.041726:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21180 x1875360098639232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482978.041740:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098639232:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.041754:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482978.041773:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098639104:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.041813:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.041834:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638208 00000100:00100000:1.0:1788482978.041839:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638208 00000100:00100000:3.0:1788482978.041841:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788482978.041851:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098637952:0@lo:400:kworker.0 00000100:00100000:1.0:1788482978.041873:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788482978.041882:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098638208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.041896:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482978.042149:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098637952 00000100:00100000:0.0:1788482978.042154:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098637952 00000100:00100000:0.0:1788482978.042187:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788482978.042194:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098637952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482978.043403:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482978.043438:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098639616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482978.048579:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098638464:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.048671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482978.048714:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098638976:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.048740:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482978.048760:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098639488:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.048778:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482978.048855:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638464 00000100:00100000:3.0:1788482978.048864:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638464 00000100:00100000:3.0:1788482978.048924:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788482978.048935:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098638464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.048999:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098638464:12345-0@lo:400:kworker.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482978.049007:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788482978.049036:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638080 00000100:00100000:3.0:1788482978.049041:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638080 00000100:00100000:3.0:1788482978.049068:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638592 00000100:00100000:3.0:1788482978.049071:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638592 00000100:00100000:3.0:1788482978.049115:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098639104 00000100:00100000:3.0:1788482978.049119:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098639104 00000100:00100000:3.0:1788482978.049136:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788482978.049142:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098638080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049372:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098638080:12345-0@lo:400:kworker.0 Request processed in 229us (7677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482978.049380:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788482978.049393:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788482978.049399:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098638592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049431:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098638592:12345-0@lo:400:kworker.0 Request processed in 33us (7680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482978.049437:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788482978.049446:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788482978.049451:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098639104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049477:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098639104:12345-0@lo:400:kworker.0 Request processed in 26us (7664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482978.049494:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788482978.049520:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098638976 00000100:00100000:3.0:1788482978.049524:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098638976 00000100:00100000:3.0:1788482978.049555:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098639488 00000100:00100000:3.0:1788482978.049558:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098639488 00000100:00100000:3.0:1788482978.049577:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788482978.049583:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098638976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049615:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098638976:12345-0@lo:400:kworker.0 Request processed in 32us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482978.049621:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788482978.049632:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788482978.049638:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098639488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049664:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098639488:12345-0@lo:400:kworker.0 Request processed in 27us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482978.049669:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788482978.049718:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098638464:0@lo:400:kworker.0 00010000:00080000:3.0:1788482978.049733:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f23480 x1875360098638976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482978.049745:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098638976:0@lo:400:kworker.0 00010000:00080000:3.0:1788482978.049756:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87b80 x1875360098639488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482978.049765:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098639488:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049777:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098638080:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049787:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098638592:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.049808:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098639104:0@lo:400:kworker.0 00000100:00080000:3.0:1788482978.049957:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482978.049962:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482978.049965:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482978.052502:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098638208:12345-0@lo:400:kworker.0 Request processed in 10606us (11835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.052519:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788482978.052736:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098638208:0@lo:400:kworker.0 00000100:00100000:0.0:1788482978.054030:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098637952:12345-0@lo:400:kworker.0 Request processed in 11827us (12125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482978.054045:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788482978.054192:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098637952:0@lo:400:kworker.0 00000100:00100000:3.0:1788482978.055761:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482978.055917:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098639616 00000100:00100000:0.0:1788482978.055928:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098639616 00000100:00100000:0.0:1788482978.055993:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788482978.056004:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098639616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788482978.056043:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482978.056140:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098639616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482978.056148:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788482978.057855:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f38380 x1875360098639616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482978.057887:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098639616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482978.555056:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098639744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788482978.555171:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482978.557294:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098639744 00000100:00100000:1.0:1788482978.557311:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098639744 00000100:00100000:1.0:1788482978.557392:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788482978.557521:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098639744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482978.557557:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482978.557663:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098639744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 260us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.557672:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788482978.557735:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4754000 x1875360098639744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482978.557760:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098639744:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788482978.936354:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482979.578601:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098639872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482979.578703:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482979.578794:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098640000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482979.578835:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482979.578879:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098639872 00000100:00100000:1.0:1788482979.578888:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098639872 00000100:00100000:1.0:1788482979.578937:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788482979.578946:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098639872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788482979.578987:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788482979.579032:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098639872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482979.579040:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788482979.579063:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640000 00000100:00100000:1.0:1788482979.579066:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640000 00000100:00100000:1.0:1788482979.579088:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788482979.579126:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098640000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788482979.579148:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482979.579177:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098640000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482979.579183:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788482979.579223:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fca80 x1875360098640000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482979.579244:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098640000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482979.579297:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098639872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788482979.580861:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098640128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482979.580938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482979.580994:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640128 00000100:00100000:2.0:1788482979.581003:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640128 00000100:00100000:2.0:1788482979.581048:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788482979.581056:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098640128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482979.581081:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482979.581158:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098640128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482979.581166:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788482979.581205:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755180 x1875360098640128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482979.581225:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098640128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788482979.961728:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482980.984664:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482981.006399:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482981.006504:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482981.006521:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087029760 00000100:00100000:3.0:1788482981.006535:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087029760 00000100:00100000:0.0:1788482981.006544:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482981.006581:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482981.006605:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 305 00000100:00100000:0.0:1788482981.006605:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482981.006617:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087029760:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482981.006623:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482981.006645:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788482981.006692:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030016 00000100:00100000:0.0:1788482981.006695:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030016 00000100:00100000:3.0:1788482981.006705:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087029760:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 90us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482981.006713:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 305 00000100:00100000:0.0:1788482981.006731:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030272 00000100:00100000:0.0:1788482981.006734:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030272 00000100:00100000:0.0:1788482981.006747:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087029888 00000100:00100000:0.0:1788482981.006749:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087029888 00000100:00100000:3.0:1788482981.006751:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030144 00000100:00100000:3.0:1788482981.006754:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030144 00000100:00100000:0.0:1788482981.006766:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 139 00000100:00100000:0.0:1788482981.006773:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087030016:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482981.006790:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 140 00000100:00100000:3.0:1788482981.006796:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030272:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482981.006810:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087030016:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482981.006817:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 139 00000100:00100000:3.0:1788482981.006818:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030272:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482981.006823:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 140 00000100:00100000:0.0:1788482981.006831:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 141 00000100:00100000:0.0:1788482981.006872:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087029888:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482981.006899:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087029888:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482981.007737:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:3.0:1788482981.007755:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030144:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482981.007877:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030144:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 129us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482981.007896:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:3.0:1788482981.007930:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030528 00000100:00100000:3.0:1788482981.007947:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030528 00000100:00100000:3.0:1788482981.007986:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030400 00000100:00100000:3.0:1788482981.007989:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030400 00000100:00100000:3.0:1788482981.008016:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:3.0:1788482981.008024:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030528:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482981.008053:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030528:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 30us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482981.008060:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:3.0:1788482981.008072:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:3.0:1788482981.008079:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030400:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482981.008406:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2393:x1875360087030400:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 325us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482981.008414:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00080000:3.0:1788482981.008437:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482981.008442:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482981.008445:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482981.008449:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788482981.010751:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 141 00000001:00100000:1.0:1788482981.632422:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000001:00100000:2.0:1788482981.632615:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000001:00100000:0.0:1788482981.632977:0:7424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000001:00100000:0.0:1788482981.648787:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00010000:00010000:1.0:1788482982.017634:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788482982.110992:0:12165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788482982.136559:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482982.136593:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098640256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788482982.136769:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482982.139010:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640256 00000100:00100000:1.0:1788482982.139034:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640256 00000100:00100000:1.0:1788482982.139243:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788482982.139277:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098640256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788482982.139338:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788482982.139476:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098640256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 212us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482982.139484:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788482982.139575:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098640256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788482983.032840:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482983.163444:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482983.163475:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098640384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482983.163564:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482983.163934:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640384 00000100:00100000:3.0:1788482983.163945:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640384 00000100:00100000:2.0:1788482983.164217:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098640512:0@lo:400:kworker.0 00000100:00100000:2.0:1788482983.164279:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482983.164309:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098641024:0@lo:400:kworker.0 00000100:00100000:2.0:1788482983.164337:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482983.164357:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098641536:0@lo:400:kworker.0 00000100:00100000:2.0:1788482983.164380:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482983.164399:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788482983.164404:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098640640:0@lo:400:kworker.0 00000100:00100000:2.0:1788482983.164427:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482983.164445:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098641152:0@lo:400:kworker.0 00000100:00100000:2.0:1788482983.164464:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482983.164481:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098641664:0@lo:400:kworker.0 00000100:00100000:3.0:1788482983.164489:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788482983.164500:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482983.164519:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098640384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482983.164533:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640640 00000100:00100000:2.0:1788482983.164538:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640640 00002000:00000024:3.0:1788482983.164558:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482983.164575:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641152 00000100:00100000:2.0:1788482983.164578:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641152 00000100:00100000:3.0:1788482983.164612:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098640384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482983.164620:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788482983.164647:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641536 00000100:00100000:3.0:1788482983.164651:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641536 00000100:00080000:0.0:1788482983.165561:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788482983.165571:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788482983.165573:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482983.165594:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640512 00000100:00100000:0.0:1788482983.165602:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640512 00000100:00100000:0.0:1788482983.165659:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788482983.165668:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098640512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.165744:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098640512:12345-0@lo:400:kworker.0 Request processed in 78us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.165752:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788482983.165792:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641664 00000100:00100000:0.0:1788482983.165797:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641664 00000100:00100000:0.0:1788482983.165825:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788482983.165831:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098640640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.165956:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098640640:12345-0@lo:400:kworker.0 Request processed in 124us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.165970:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788482983.165985:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788482983.165991:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098641664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166019:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098641664:12345-0@lo:400:kworker.0 Request processed in 30us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.166024:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788482983.166071:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098640768:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166123:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482983.166153:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098641280:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166175:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482983.166189:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098641792:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166209:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788482983.166239:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376f480 x1875360098640384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482983.166272:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098640384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482983.166296:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788482983.166303:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098640896:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166327:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482983.166340:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098641408:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166364:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482983.166401:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098641920:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166425:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482983.166476:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641024 00000100:00100000:0.0:1788482983.166488:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641024 00000100:00100000:0.0:1788482983.166519:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640768 00000100:00100000:0.0:1788482983.166522:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640768 00000100:00100000:0.0:1788482983.166536:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788482983.166542:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098641024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166581:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098641024:12345-0@lo:400:kworker.0 Request processed in 40us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.166588:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788482983.166600:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788482983.166606:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098640768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166634:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098640768:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.166640:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788482983.166654:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641280 00000100:00100000:0.0:1788482983.166657:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641280 00000100:00100000:0.0:1788482983.166673:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641792 00000100:00100000:0.0:1788482983.166675:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641792 00000100:00100000:0.0:1788482983.166685:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098640896 00000100:00100000:0.0:1788482983.166687:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098640896 00000100:00100000:0.0:1788482983.166698:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788482983.166702:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098641280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166727:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098641280:12345-0@lo:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.166732:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788482983.166741:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788482983.166747:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098641792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166767:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098641792:12345-0@lo:400:kworker.0 Request processed in 21us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.166780:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788482983.166790:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788482983.166795:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098640896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.166823:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098640896:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.166829:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788482983.167010:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641408 00000100:00100000:0.0:1788482983.167016:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641408 00000100:00100000:0.0:1788482983.167048:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098641920 00000100:00100000:0.0:1788482983.167050:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098641920 00000100:00100000:0.0:1788482983.167065:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788482983.167070:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098641408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.167131:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098641408:12345-0@lo:400:kworker.0 Request processed in 60us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.167137:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788482983.167148:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788482983.167153:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098641920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.167181:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098641920:12345-0@lo:400:kworker.0 Request processed in 28us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.167186:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788482983.167231:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098640640:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.167250:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098641664:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.167272:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098640512:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.167289:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098641024:0@lo:400:kworker.0 00000100:00100000:2.0:1788482983.167301:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788482983.167315:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098641152:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788482983.167336:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482983.167342:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788482983.167345:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788482983.167348:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482983.167370:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098640896:0@lo:400:kworker.0 00000100:00100000:3.0:1788482983.167687:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788482983.167696:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098641536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482983.167816:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098641152:12345-0@lo:400:kworker.0 Request processed in 503us (3349us total) trans 0 rc 0/0 00010000:00080000:0.0:1788482983.167819:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769f80 x1875360098641408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482983.167828:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788482983.167912:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098641408:0@lo:400:kworker.0 00010000:00080000:0.0:1788482983.167928:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376bb80 x1875360098641920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482983.167937:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098641920:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.167950:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098640768:0@lo:400:kworker.0 00010000:00080000:0.0:1788482983.167962:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3768380 x1875360098641280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482983.167970:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098641280:0@lo:400:kworker.0 00010000:00080000:0.0:1788482983.167981:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376ad80 x1875360098641792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482983.167989:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098641792:0@lo:400:kworker.0 00000100:00100000:0.0:1788482983.168032:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098641152:0@lo:400:kworker.0 00000100:00100000:3.0:1788482983.168237:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098641536:12345-0@lo:400:kworker.0 Request processed in 541us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482983.168245:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788482983.168342:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376aa00 x1875360098641536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482983.168353:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098641536:0@lo:400:kworker.0 00000100:00100000:1.0:1788482983.673046:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788482983.673080:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098642048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788482983.673202:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482983.673429:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642048 00000100:00100000:2.0:1788482983.673439:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642048 00000100:00100000:2.0:1788482983.673509:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788482983.673704:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098642048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788482983.673731:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482983.673791:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098642048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482983.673799:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788482983.673867:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376aa00 x1875360098642048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482983.673889:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098642048:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788482984.057612:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482984.700539:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482984.700562:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098642176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482984.700633:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482984.700697:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642176 00000100:00100000:0.0:1788482984.700703:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642176 00000100:00100000:0.0:1788482984.700748:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788482984.700758:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f6588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098642176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482984.700788:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482984.700839:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f6588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098642176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482984.700846:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1788482984.701040:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755c00 x1875360098642176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482984.701059:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098642176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482984.703366:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482984.703385:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098642304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788482984.703413:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482984.703426:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098642432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482984.703448:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482984.703467:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482984.703706:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642304 00000100:00100000:1.0:1788482984.703714:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642304 00000100:00100000:1.0:1788482984.703755:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788482984.703763:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098642304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788482984.703782:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482984.703920:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642432 00000100:00100000:0.0:1788482984.703925:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642432 00000100:00100000:1.0:1788482984.703931:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098642304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482984.703946:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788482984.703958:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788482984.703967:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098642432:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788482984.703987:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21f80 x1875360098642304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:0.0:1788482984.703991:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788482984.704010:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098642304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788482984.704038:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098642432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482984.704046:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788482984.704093:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098642432:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788482985.084186:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482986.106385:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482986.141898:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482986.141942:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482986.141976:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482986.142003:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482986.142025:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482986.142045:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482986.142070:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482986.142120:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030912 00000100:00100000:1.0:1788482986.142130:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030912 00000100:00100000:1.0:1788482986.142177:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031168 00000100:00100000:1.0:1788482986.142180:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031168 00000100:00100000:1.0:1788482986.142191:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030784 00000100:00100000:1.0:1788482986.142193:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030784 00000100:00100000:1.0:1788482986.142203:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031040 00000100:00100000:1.0:1788482986.142205:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031040 00000100:00100000:1.0:1788482986.142231:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 149 00000100:00100000:1.0:1788482986.142240:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087030912:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482986.142331:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087030912:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 91us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482986.142339:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 149 00000100:00100000:1.0:1788482986.142355:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:1.0:1788482986.142361:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031168:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482986.142385:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031168:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482986.142390:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:1.0:1788482986.142401:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:1.0:1788482986.142418:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087030784:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482986.142445:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087030784:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482986.142451:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:1.0:1788482986.142463:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00100000:1.0:1788482986.142469:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031040:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482986.142494:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031040:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482986.142500:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00100000:1.0:1788482986.142518:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031424 00000100:00100000:1.0:1788482986.142522:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031424 00000100:00100000:1.0:1788482986.142545:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031296 00000100:00100000:1.0:1788482986.142548:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031296 00000100:00100000:1.0:1788482986.142565:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:1.0:1788482986.142570:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031424:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482986.142594:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031424:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482986.142600:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:1.0:1788482986.142612:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:1.0:1788482986.142630:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031296:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482986.142653:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087031296:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 36us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482986.142658:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00080000:1.0:1788482986.142683:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482986.142691:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482986.142693:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482986.142696:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788482986.143404:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087030656 00000100:00100000:3.0:1788482986.143412:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087030656 00000100:00100000:3.0:1788482986.143454:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 307 00000100:00100000:3.0:1788482986.143461:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2392:x1875360087030656:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482986.143505:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2392:x1875360087030656:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 45us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482986.143511:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 307 00010000:00010000:0.0:1788482987.128487:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482987.264466:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098642560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788482987.264542:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482987.264619:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642560 00000100:00100000:3.0:1788482987.264628:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642560 00000100:00100000:3.0:1788482987.264672:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788482987.264681:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098642560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788482987.264714:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482987.264771:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098642560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482987.264778:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788482987.264824:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098642560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788482988.152355:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482988.281555:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098642816:0@lo:400:kworker.0 00000100:00100000:2.0:1788482988.281623:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482988.281677:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098643328:0@lo:400:kworker.0 00000100:00100000:2.0:1788482988.281700:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482988.281723:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098643840:0@lo:400:kworker.0 00000100:00100000:2.0:1788482988.281746:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482988.281775:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788482988.281783:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098644352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482988.281816:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482988.281849:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098642944:0@lo:400:kworker.0 00000100:00100000:2.0:1788482988.281877:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482988.281898:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098643456:0@lo:400:kworker.0 00000100:00100000:2.0:1788482988.281920:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482988.281937:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098643968:0@lo:400:kworker.0 00000100:00100000:2.0:1788482988.281960:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482988.281987:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642944 00000100:00100000:2.0:1788482988.281995:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642944 00000100:00100000:3.0:1788482988.282346:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098642688:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282385:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.282410:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098643200:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282429:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.282442:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098643712:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282461:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.282475:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098644224:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282494:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.282511:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788482988.282516:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098643072:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282545:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.282554:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098643584:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282569:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.282581:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098644096:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282611:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.282634:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642688 00000100:00100000:3.0:1788482988.282637:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642688 00000100:00100000:3.0:1788482988.282669:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788482988.282678:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098642688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.282719:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098642688:12345-0@lo:400:kworker.0 Request processed in 42us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482988.282734:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788482988.282762:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643200 00000100:00100000:3.0:1788482988.282765:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643200 00000100:00100000:1.0:1788482988.282854:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098642816 00000100:00100000:1.0:1788482988.282858:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098642816 00000100:00100000:1.0:1788482988.282880:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643328 00000100:00100000:1.0:1788482988.282883:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643328 00000100:00100000:1.0:1788482988.282904:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643840 00000100:00100000:1.0:1788482988.282907:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643840 00000100:00100000:1.0:1788482988.282917:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643456 00000100:00100000:1.0:1788482988.282920:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643456 00000100:00100000:1.0:1788482988.282930:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643968 00000100:00100000:1.0:1788482988.282932:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643968 00000100:00100000:1.0:1788482988.282942:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643072 00000100:00100000:1.0:1788482988.282944:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643072 00000100:00100000:1.0:1788482988.282955:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788482988.282961:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098642816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.283003:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098642816:12345-0@lo:400:kworker.0 Request processed in 41us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482988.283009:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788482988.283181:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788482988.283189:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098642944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482988.283244:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098642944:12345-0@lo:400:kworker.0 Request processed in 46us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482988.283249:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788482988.283345:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788482988.283353:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098643328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.283384:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098643328:12345-0@lo:400:kworker.0 Request processed in 32us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482988.283389:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788482988.283402:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788482988.283408:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098643840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.283433:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098643840:12345-0@lo:400:kworker.0 Request processed in 25us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482988.283449:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788482988.283461:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788482988.283467:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098643456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.283495:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098643456:12345-0@lo:400:kworker.0 Request processed in 28us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482988.283500:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788482988.283512:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788482988.283517:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098643968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.284439:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788482988.284524:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098643200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.284581:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098643200:12345-0@lo:400:kworker.0 Request processed in 134us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482988.284588:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788482988.284618:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643712 00000100:00100000:3.0:1788482988.284625:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643712 00000100:00100000:3.0:1788482988.284649:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644224 00000100:00100000:3.0:1788482988.284651:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644224 00000100:00100000:3.0:1788482988.284661:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098643584 00000100:00100000:3.0:1788482988.284664:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098643584 00000100:00100000:3.0:1788482988.284674:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644096 00000100:00100000:3.0:1788482988.284676:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644096 00000100:00100000:3.0:1788482988.284688:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788482988.284694:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098643712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.284727:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098643712:12345-0@lo:400:kworker.0 Request processed in 33us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482988.284734:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788482988.284745:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788482988.284751:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098644224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.284780:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098644224:12345-0@lo:400:kworker.0 Request processed in 29us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482988.284786:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788482988.284797:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788482988.284897:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098643584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.284930:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098643584:12345-0@lo:400:kworker.0 Request processed in 117us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482988.284936:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788482988.285005:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788482988.285013:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098644096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.285041:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098644096:12345-0@lo:400:kworker.0 Request processed in 30us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482988.285047:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788482988.285065:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098643968:12345-0@lo:400:kworker.0 Request processed in 1547us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482988.285072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788482988.285085:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788482988.285092:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098643072:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788482988.285107:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376b480 x1875360098643584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482988.285121:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098643584:0@lo:400:kworker.0 00010000:00080000:3.0:1788482988.285134:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde9f80 x1875360098644096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482988.285135:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098643072:12345-0@lo:400:kworker.0 Request processed in 44us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482988.285140:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788482988.285143:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098644096:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.285154:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098642688:0@lo:400:kworker.0 00000100:00100000:3.0:1788482988.285164:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098643200:0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.285166:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644352 00000100:00100000:1.0:1788482988.285170:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644352 00010000:00080000:3.0:1788482988.285172:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769c00 x1875360098643712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482988.285180:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098643712:0@lo:400:kworker.0 00010000:00080000:3.0:1788482988.285190:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efde8700 x1875360098644224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482988.285196:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788482988.285197:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098644224:0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.285210:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098644352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482988.285240:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482988.285263:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098643072:0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.285271:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098644352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482988.285277:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788482988.285301:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482988.285310:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482988.285313:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788482988.285316:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788482988.285339:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755c00 x1875360098644352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482988.285352:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098644352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482988.285364:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098642944:0@lo:400:kworker.0 00010000:00080000:1.0:1788482988.285375:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769880 x1875360098643456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482988.285383:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098643456:0@lo:400:kworker.0 00010000:00080000:1.0:1788482988.285393:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376aa00 x1875360098643968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482988.285400:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098643968:0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.285412:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098642816:0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.285422:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098643328:0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.285432:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098643840:0@lo:400:kworker.0 00000100:00100000:1.0:1788482988.792356:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482988.792489:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098644480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788482988.792556:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482988.792663:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644480 00000100:00100000:3.0:1788482988.792671:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644480 00000100:00100000:3.0:1788482988.792718:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788482988.792727:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098644480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788482988.792757:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788482988.792803:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098644480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482988.792822:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788482988.792993:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22680 x1875360098644480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482988.793010:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098644480:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788482989.176246:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482989.823348:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482989.823400:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098644608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482989.823468:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482989.823525:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644608 00000100:00100000:2.0:1788482989.823532:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644608 00000100:00100000:2.0:1788482989.823573:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788482989.823582:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098644608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482989.823608:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482989.823647:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098644608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482989.823655:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788482989.823690:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd930000 x1875360098644608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482989.823725:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098644608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482989.829159:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482989.829179:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098644736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482989.829299:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482989.829358:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644736 00000100:00100000:1.0:1788482989.829366:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644736 00000100:00100000:1.0:1788482989.829409:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788482989.829417:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098644736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788482989.829447:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788482989.829490:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098644736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482989.829497:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788482989.829543:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098644736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788482989.831924:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098644864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788482989.831987:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482989.832051:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644864 00000100:00100000:0.0:1788482989.832057:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644864 00000100:00100000:0.0:1788482989.832121:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788482989.832130:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098644864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788482989.832150:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788482989.832191:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098644864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482989.832198:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788482989.832245:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4754380 x1875360098644864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482989.832262:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098644864:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788482990.204704:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788482990.358728:0:12480:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788482990.359019:0:12480:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788482991.224850:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482991.249079:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482991.249138:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482991.249162:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482991.249185:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482991.249282:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482991.249304:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482991.249325:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788482991.249401:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031552 00000100:00100000:3.0:1788482991.249410:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031552 00000100:00100000:3.0:1788482991.249457:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 309 00000100:00100000:3.0:1788482991.249467:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087031552:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482991.249575:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087031552:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 109us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.249583:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 309 00000100:00100000:3.0:1788482991.249616:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031808 00000100:00100000:3.0:1788482991.249620:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031808 00000100:00100000:3.0:1788482991.249661:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032064 00000100:00100000:3.0:1788482991.249664:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032064 00000100:00100000:3.0:1788482991.250812:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031680 00000100:00100000:3.0:1788482991.250821:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031680 00000100:00100000:3.0:1788482991.250854:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087031936 00000100:00100000:3.0:1788482991.250857:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087031936 00000100:00100000:3.0:1788482991.250876:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 159 00000100:00100000:3.0:1788482991.250885:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087031808:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482991.250936:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087031808:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 52us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.250944:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 159 00000100:00100000:3.0:1788482991.250959:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 160 00000100:00100000:3.0:1788482991.250966:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087032064:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482991.250990:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087032064:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.250996:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 160 00000100:00100000:3.0:1788482991.251007:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 161 00000100:00100000:3.0:1788482991.251012:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087031680:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482991.251032:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087031680:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 20us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.251038:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 161 00000100:00100000:3.0:1788482991.251048:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 162 00000100:00100000:3.0:1788482991.251054:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087031936:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482991.251075:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087031936:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 21us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.251668:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 162 00000100:00100000:3.0:1788482991.251772:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032320 00000100:00100000:3.0:1788482991.251778:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032320 00000100:00100000:3.0:1788482991.251855:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032192 00000100:00100000:3.0:1788482991.251859:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032192 00000100:00100000:0.0:1788482991.258385:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:0.0:1788482991.258410:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087032320:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482991.258486:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087032320:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 88us (9299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482991.258494:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:0.0:1788482991.258518:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:0.0:1788482991.258526:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087032192:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788482991.258551:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087032192:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 27us (9225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482991.258571:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00080000:1.0:1788482991.265304:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482991.265314:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482991.265317:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482991.265320:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788482992.248315:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482992.376406:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482992.381359:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098644992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788482992.381440:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482992.384380:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098644992 00000100:00100000:3.0:1788482992.384394:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098644992 00000100:00100000:3.0:1788482992.384455:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788482992.384464:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098644992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788482992.384522:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788482992.384604:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098644992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.384611:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788482992.384784:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098644992:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788482992.576524:0:12577:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788482992.576923:0:12577:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788482993.274536:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482993.401478:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098645504:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.401572:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482993.401621:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098646016:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.401646:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482993.401666:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098646528:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.401685:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482993.401707:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788482993.401713:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098645376:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.401735:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482993.401751:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098645888:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.401769:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482993.401784:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098646400:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.401802:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482993.401828:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098645504 00000100:00100000:2.0:1788482993.401835:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098645504 00000100:00100000:2.0:1788482993.401870:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098645888 00000100:00100000:2.0:1788482993.401873:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098645888 00000100:00100000:2.0:1788482993.401889:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646400 00000100:00100000:2.0:1788482993.401892:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646400 00000100:00100000:2.0:1788482993.401907:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788482993.401914:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098645504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.401961:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098645504:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.401980:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788482993.401997:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788482993.402002:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098645888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.402032:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098645888:12345-0@lo:400:kworker.0 Request processed in 29us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.402038:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788482993.402048:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788482993.402053:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098646400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.402077:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098646400:12345-0@lo:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.402083:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788482993.402119:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646016 00000100:00100000:2.0:1788482993.402123:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646016 00000100:00100000:2.0:1788482993.402144:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646528 00000100:00100000:2.0:1788482993.402147:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646528 00000100:00100000:2.0:1788482993.402163:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788482993.402170:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098646016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.402224:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098646016:12345-0@lo:400:kworker.0 Request processed in 54us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.402231:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788482993.402242:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788482993.402248:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098646528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.402274:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098646528:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.402281:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788482993.402304:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098645376 00000100:00100000:2.0:1788482993.402308:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098645376 00000100:00100000:2.0:1788482993.402331:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788482993.402337:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098645376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.402367:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098645376:12345-0@lo:400:kworker.0 Request processed in 30us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.402373:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788482993.402413:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098645376:0@lo:400:kworker.0 00010000:00080000:2.0:1788482993.402427:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fb100 x1875360098645888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482993.402437:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098645888:0@lo:400:kworker.0 00010000:00080000:2.0:1788482993.402446:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fb480 x1875360098646400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482993.402455:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098646400:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.402464:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098645504:0@lo:400:kworker.0 00010000:00080000:2.0:1788482993.402472:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fbb80 x1875360098646016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482993.402481:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098646016:0@lo:400:kworker.0 00010000:00080000:2.0:1788482993.402490:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f8e00 x1875360098646528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482993.402499:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098646528:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403069:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098645120:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403141:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.403184:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098645632:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403218:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.403237:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098646144:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403257:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.403285:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098646656:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403306:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.403334:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788482993.403341:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098645248:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403399:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.403416:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098645760:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403434:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.403447:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098646272:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403466:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.403488:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098645248 00000100:00100000:1.0:1788482993.403492:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098645248 00000100:00100000:1.0:1788482993.403515:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098645760 00000100:00100000:1.0:1788482993.403517:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098645760 00000100:00100000:1.0:1788482993.403529:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646272 00000100:00100000:1.0:1788482993.403532:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646272 00000100:00100000:1.0:1788482993.403545:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788482993.403551:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098645248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403589:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098645248:12345-0@lo:400:kworker.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.403596:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788482993.403611:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788482993.403617:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098645760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403641:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098645760:12345-0@lo:400:kworker.0 Request processed in 25us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.403647:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788482993.403658:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788482993.403664:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098646272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403697:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098646272:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.403704:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1788482993.403724:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482993.403727:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482993.403730:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482993.403732:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788482993.403740:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646144 00000100:00100000:1.0:1788482993.403744:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646144 00000100:00100000:1.0:1788482993.403762:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646656 00000100:00100000:1.0:1788482993.403765:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646656 00000100:00100000:1.0:1788482993.403777:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788482993.403782:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098646144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403813:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098646144:12345-0@lo:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.403819:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788482993.403830:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788482993.403835:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098646656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403858:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098646656:12345-0@lo:400:kworker.0 Request processed in 23us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.403864:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788482993.403881:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098645120 00000100:00100000:1.0:1788482993.403885:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098645120 00000100:00100000:1.0:1788482993.403907:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788482993.403912:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098645120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.403941:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098645120:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.403956:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788482993.403982:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098645632 00000100:00100000:1.0:1788482993.403987:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098645632 00000100:00100000:1.0:1788482993.404007:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788482993.404013:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098645632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.404045:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098645632:12345-0@lo:400:kworker.0 Request processed in 33us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.404051:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788482993.404069:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482993.404072:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482993.404121:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098645248:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.404133:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098645760:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.404141:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098646272:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.404147:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098645120:0@lo:400:kworker.0 00000100:00100000:1.0:1788482993.404155:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098645632:0@lo:400:kworker.0 00010000:00080000:1.0:1788482993.404165:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f9500 x1875360098646144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482993.404174:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098646144:0@lo:400:kworker.0 00010000:00080000:1.0:1788482993.404182:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c59e5f80 x1875360098646656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482993.404191:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098646656:0@lo:400:kworker.0 00000100:00100000:2.0:1788482993.406725:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482993.406747:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098646784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482993.406862:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482993.406907:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646784 00000100:00100000:2.0:1788482993.406914:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646784 00000100:00100000:2.0:1788482993.406959:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788482993.406970:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098646784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788482993.406998:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482993.407040:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098646784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.407047:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788482993.407082:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c59e6300 x1875360098646784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482993.407126:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098646784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482993.912230:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482993.912265:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098646912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788482993.912325:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482993.912389:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098646912 00000100:00100000:1.0:1788482993.912397:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098646912 00000100:00100000:1.0:1788482993.912447:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788482993.912457:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098646912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788482993.912478:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482993.912520:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098646912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.912527:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788482993.912562:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fdc00 x1875360098646912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482993.912581:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098646912:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788482994.297197:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788482994.879084:0:12676:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482994.881387:0:12676:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788482994.937611:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788482994.937633:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098647040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482994.937696:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482994.937757:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647040 00000100:00100000:2.0:1788482994.937764:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647040 00000100:00100000:2.0:1788482994.937809:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788482994.937818:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098647040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482994.937847:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482994.937890:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098647040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482994.937898:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788482994.937945:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c59e6300 x1875360098647040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482994.937963:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098647040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482994.938499:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788482994.938511:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098647168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482994.938545:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482994.938579:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647168 00000100:00100000:1.0:1788482994.938584:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647168 00000100:00100000:1.0:1788482994.938610:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788482994.938616:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098647168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788482994.938628:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788482994.938658:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098647168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482994.938665:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788482994.938698:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f4755500 x1875360098647168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482994.938723:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098647168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788482994.938869:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098647296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788482994.938897:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482994.939282:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647296 00000100:00100000:0.0:1788482994.939287:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647296 00000100:00100000:0.0:1788482994.940931:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788482994.940949:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098647296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788482994.940983:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788482994.941055:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098647296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.941062:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788482994.945496:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098647296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788482995.324687:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482996.348623:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482996.367652:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482996.367695:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482996.367739:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482996.367768:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482996.367791:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482996.367807:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482996.367829:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788482996.367853:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032704 00000100:00100000:1.0:1788482996.367872:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032704 00000100:00100000:1.0:1788482996.367918:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032960 00000100:00100000:1.0:1788482996.367921:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032960 00000100:00100000:1.0:1788482996.367932:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032576 00000100:00100000:1.0:1788482996.367935:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032576 00000100:00100000:1.0:1788482996.367945:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032832 00000100:00100000:1.0:1788482996.367948:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032832 00000100:00100000:1.0:1788482996.367963:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 169 00000100:00100000:1.0:1788482996.367972:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087032704:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788482996.368055:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087032704:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 83us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.368063:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 169 00000100:00100000:1.0:1788482996.368081:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 170 00000100:00100000:1.0:1788482996.368088:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087032960:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482996.368264:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087032448 00000100:00100000:3.0:1788482996.368269:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087032448 00000100:00100000:3.0:1788482996.368300:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 311 00000100:00100000:3.0:1788482996.368319:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087032448:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482996.368346:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087032448:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 40us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482996.368352:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 311 00000100:00100000:3.0:1788482996.368402:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 171 00000100:00100000:3.0:1788482996.368410:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087032576:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482996.368445:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087032576:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482996.368452:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 171 00000100:00100000:3.0:1788482996.368475:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 172 00000100:00100000:3.0:1788482996.368482:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087032832:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788482996.368508:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087032832:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482996.368514:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 172 00000100:00100000:3.0:1788482996.368532:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033088 00000100:00100000:3.0:1788482996.368536:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033088 00000100:00100000:3.0:1788482996.368558:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033216 00000100:00100000:3.0:1788482996.368561:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033216 00000100:00100000:3.0:1788482996.368578:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788482996.368584:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2389:x1875360087033088:12345-192.168.206.54@tcp:9:kworker.0 00000020:00000080:3.0:1788482996.368601:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a66b 00000100:00080000:3.0:1788482996.368609:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788482996.368647:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788482996.368757:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+2:2389:x1875360087033088:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 172us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482996.368764:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788482996.368775:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:3.0:1788482996.368781:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2389:x1875360087033216:12345-192.168.206.54@tcp:9:kworker.0 00000020:00000080:3.0:1788482996.368792:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a672 00000100:00080000:3.0:1788482996.368797:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788482996.368817:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788482996.368883:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+2:2389:x1875360087033216:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 101us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482996.368891:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00080000:3.0:1788482996.369037:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482996.369047:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482996.369049:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482996.369051:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788482996.369620:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482996.369780:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482996.371569:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087032960:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 73us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.371585:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 170 00010000:00010000:2.0:1788482997.368282:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788482997.443588:0:12773:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788482997.443807:0:12773:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788482997.505808:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482997.505829:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098647424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788482997.505893:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482997.505976:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647424 00000100:00100000:2.0:1788482997.505985:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647424 00000100:00100000:2.0:1788482997.506039:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788482997.506049:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098647424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788482997.506082:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788482997.506234:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098647424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.506241:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788482997.509363:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098647424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788482998.392717:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482998.520323:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098647936:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.520390:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482998.520435:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098648448:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.520905:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098647552:0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.523400:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098647808:0@lo:400:kworker.0 00000100:00100000:3.0:1788482998.523507:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647936 00000100:00100000:3.0:1788482998.523515:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647936 00000100:00100000:3.0:1788482998.523567:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788482998.523576:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098647936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.523774:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.523817:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098648064:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.523843:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.523868:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098648576:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.523890:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.523907:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098649088:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.523926:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.523955:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647552 00000100:00100000:1.0:1788482998.523959:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647552 00000100:00100000:1.0:1788482998.523986:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788482998.523992:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098647552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.524027:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098647552:12345-0@lo:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.524035:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788482998.524064:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648064 00000100:00100000:1.0:1788482998.524068:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648064 00000100:00100000:1.0:1788482998.524118:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788482998.524125:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098648064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.524239:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098648064:12345-0@lo:400:kworker.0 Request processed in 114us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.524246:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788482998.524277:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098647552:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.524295:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098648064:0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.524407:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482998.524431:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482998.524443:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098648320:0@lo:400:kworker.0 00000100:00100000:3.0:1788482998.524471:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098647936:12345-0@lo:400:kworker.0 Request processed in 894us (4079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482998.524479:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788482998.524494:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647808 00000100:00100000:1.0:1788482998.524499:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647808 00000100:00100000:1.0:1788482998.524526:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788482998.524539:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098647808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.524547:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482998.524557:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098648960:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.524589:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.524651:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098647808:12345-0@lo:400:kworker.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.524658:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788482998.524712:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098647936:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.524733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098647680:0@lo:400:kworker.0 00000100:00100000:3.0:1788482998.524908:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648320 00000100:00100000:3.0:1788482998.524912:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648320 00000100:00100000:2.0:1788482998.524932:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648576 00000100:00100000:0.0:1788482998.524933:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098648832:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.524943:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648576 00000100:00100000:0.0:1788482998.524964:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482998.524979:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649088 00000100:00100000:2.0:1788482998.524984:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649088 00000100:00100000:0.0:1788482998.525003:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098647808:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.525007:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648448 00000100:00100000:3.0:1788482998.525009:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648832 00000100:00100000:2.0:1788482998.525011:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648448 00000100:00100000:3.0:1788482998.525014:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648832 00000100:00100000:0.0:1788482998.525036:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788482998.525037:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648960 00000100:00100000:0.0:1788482998.525047:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098648320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.525075:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482998.525144:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648960 00000100:00100000:3.0:1788482998.525165:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098647680 00000100:00100000:3.0:1788482998.525170:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098647680 00000100:00100000:2.0:1788482998.525190:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788482998.525200:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098648576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.525216:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098648320:12345-0@lo:400:kworker.0 Request processed in 170us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482998.525224:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788482998.525245:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788482998.525249:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098648576:12345-0@lo:400:kworker.0 Request processed in 49us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482998.525259:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788482998.525259:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098648832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.525263:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788482998.525274:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098647680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.525285:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788482998.525295:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098649088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.525308:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098648832:12345-0@lo:400:kworker.0 Request processed in 54us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482998.525314:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00080000:0.0:1788482998.525343:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fbb80 x1875360098648320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482998.525354:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098648320:0@lo:400:kworker.0 00010000:00080000:0.0:1788482998.525364:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f8700 x1875360098648832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482998.525371:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098648832:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.525444:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098649088:12345-0@lo:400:kworker.0 Request processed in 152us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482998.525451:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788482998.525463:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788482998.525469:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098648448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482998.525489:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098647680:12345-0@lo:400:kworker.0 Request processed in 217us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482998.525496:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788482998.525515:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098648448:12345-0@lo:400:kworker.0 Request processed in 46us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482998.525521:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788482998.525528:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788482998.525533:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098648960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482998.525568:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098648960:12345-0@lo:400:kworker.0 Request processed in 40us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482998.525574:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788482998.525603:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482998.525608:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788482998.525611:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482998.525658:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f9c00 x1875360098648448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482998.525669:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098648448:0@lo:400:kworker.0 00010000:00080000:0.0:1788482998.525679:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3cc7100 x1875360098648960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482998.525688:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098648960:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.525705:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098647680:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.525716:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098648192:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.525740:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.525760:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098648704:0@lo:400:kworker.0 00000100:00100000:1.0:1788482998.525778:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.525833:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098649216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482998.525855:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482998.526028:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648192 00000100:00100000:2.0:1788482998.526033:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648192 00000100:00100000:2.0:1788482998.526060:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098648704 00000100:00100000:2.0:1788482998.526063:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098648704 00000100:00100000:2.0:1788482998.526075:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788482998.526081:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098648192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.526135:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788482998.526145:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098648704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.526217:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098648704:12345-0@lo:400:kworker.0 Request processed in 73us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482998.526224:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788482998.526261:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098648704:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.526262:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098648192:12345-0@lo:400:kworker.0 Request processed in 178us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482998.526275:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788482998.526283:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098648192:0@lo:400:kworker.0 00000100:00100000:2.0:1788482998.526313:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649216 00000100:00100000:2.0:1788482998.526318:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649216 00000100:00100000:2.0:1788482998.526347:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788482998.526356:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098649216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788482998.526380:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482998.526421:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098649216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482998.526429:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788482998.526444:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376ad80 x1875360098649216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788482998.526449:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788482998.526646:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fb480 x1875360098648576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482998.526672:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098648576:0@lo:400:kworker.0 00010000:00080000:1.0:1788482998.526686:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3cc6680 x1875360098649088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482998.526694:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098649088:0@lo:400:kworker.0 00000100:00100000:0.0:1788482998.526869:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098649216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482999.034294:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098649344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788482999.034363:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482999.035954:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649344 00000100:00100000:2.0:1788482999.035965:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649344 00000100:00100000:2.0:1788482999.036027:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788482999.036038:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098649344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788482999.036060:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788482999.036264:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098649344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 228us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482999.036272:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788482999.037053:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3cc6680 x1875360098649344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482999.037073:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098649344:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788482999.416667:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788482999.506598:0:12870:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788482999.506782:0:12870:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788483000.056268:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098649600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483000.056268:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098649472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483000.056347:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483000.056417:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649472 00000100:00100000:0.0:1788483000.056423:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649472 00000100:00100000:1.0:1788483000.056653:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483000.056702:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098649728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483000.056740:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483000.056774:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649600 00000100:00100000:2.0:1788483000.056778:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649600 00000100:00100000:2.0:1788483000.056814:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649728 00000100:00100000:2.0:1788483000.056817:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649728 00000100:00100000:2.0:1788483000.056853:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788483000.056862:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098649600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483000.056892:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483000.056936:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098649600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483000.056942:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788483000.056959:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788483000.056965:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098649728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483000.056974:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483000.057016:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098649728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483000.057021:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788483000.057125:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788483000.057403:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3cc7100 x1875360098649728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483000.057422:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098649728:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788483000.057453:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f9500 x1875360098649600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483000.057464:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098649600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483000.057557:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788483000.057570:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098649472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483000.057594:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788483000.057633:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098649472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483000.060528:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098649472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483000.071505:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00010000:2.0:1788483000.444642:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483001.464519:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483001.485184:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483001.485230:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483001.485246:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483001.485273:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483001.485365:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483001.485411:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033344 00000100:00100000:1.0:1788483001.485421:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033344 00000100:00100000:1.0:1788483001.485468:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 313 00000100:00100000:1.0:1788483001.485478:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087033344:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483001.485545:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087033344:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 67us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483001.485553:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 313 00000100:00100000:2.0:1788483001.494197:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033600 00000100:00100000:2.0:1788483001.494210:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033600 00000100:00100000:2.0:1788483001.494596:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033856 00000100:00100000:2.0:1788483001.494601:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033856 00000100:00080000:1.0:1788483001.496203:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483001.496229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033472 00000100:00100000:1.0:1788483001.496246:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033472 00000100:00100000:1.0:1788483001.496289:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 179 00000100:00100000:1.0:1788483001.496300:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087033600:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483001.496382:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087033600:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 83us (11150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483001.496389:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 179 00000100:00100000:1.0:1788483001.496405:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 180 00000100:00100000:1.0:1788483001.496411:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087033472:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483001.496436:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087033472:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (11163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483001.496443:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 180 00000100:00080000:1.0:1788483001.496579:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483001.501324:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033728 00000100:00100000:1.0:1788483001.501337:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033728 00000100:00100000:1.0:1788483001.501517:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 181 00000100:00100000:1.0:1788483001.501528:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087033728:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483001.501601:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087033728:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 75us (16244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483001.501609:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 181 00000100:00100000:2.0:1788483001.502609:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 182 00000100:00100000:2.0:1788483001.502634:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087033856:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483001.502685:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087033856:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 53us (17437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483001.502692:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 182 00000100:00080000:0.0:1788483001.508501:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788483001.595035:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000020:00000080:0.0:1788483001.595044:0:8405:0:(genops.c:885:class_export_put()) final put ffff9a68c36b4800/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000020:00000080:1.0:1788483001.595146:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b4800/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce for lustre-OST0000 00000020:00000080:1.0:1788483001.595199:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c36b6000 for lustre-OST0000 00000001:00100000:2.0:1788483001.595390:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000020:00000080:2.0:1788483001.595394:0:9489:0:(genops.c:885:class_export_put()) final put ffff9a68c36b4000/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000020:00000080:0.0:1788483001.595923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b4000/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce for lustre-OST0001 00000020:00000080:0.0:1788483001.595960:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c36b5000 for lustre-OST0001 00010000:00010000:2.0:1788483002.489010:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483002.617432:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098649856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483002.617501:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483002.617719:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649856 00000100:00100000:1.0:1788483002.617726:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649856 00000100:00100000:1.0:1788483002.617809:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788483002.617819:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098649856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483002.617851:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788483002.617909:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098649856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483002.617916:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788483002.618829:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098649856:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788483002.902995:0:13015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788483003.512546:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483003.640866:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098650112:0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.641024:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098650240:0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.641093:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098649984:0@lo:400:kworker.0 00000100:00100000:3.0:1788483003.641294:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098650368:0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.641428:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483003.641478:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098650752:0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.641503:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483003.641521:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098651264:0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.641540:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483003.641577:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098650240 00000100:00100000:0.0:1788483003.641584:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098650240 00000100:00100000:0.0:1788483003.641626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788483003.641635:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098650240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.641692:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098650240:12345-0@lo:400:kworker.0 Request processed in 57us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483003.641700:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788483003.641722:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098650752 00000100:00100000:0.0:1788483003.641741:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098650752 00000100:00100000:0.0:1788483003.641775:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651264 00000100:00100000:0.0:1788483003.641779:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651264 00000100:00100000:0.0:1788483003.641800:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788483003.641807:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098650752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.641839:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098650752:12345-0@lo:400:kworker.0 Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483003.641845:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788483003.641856:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788483003.641861:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098651264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.641885:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098651264:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483003.641983:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788483003.642030:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098650240:0@lo:400:kworker.0 00010000:00080000:0.0:1788483003.642045:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f7b80 x1875360098650752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483003.642055:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098650752:0@lo:400:kworker.0 00010000:00080000:0.0:1788483003.642065:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f6d80 x1875360098651264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483003.642073:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098651264:0@lo:400:kworker.0 00000100:00080000:0.0:1788483003.642203:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483003.642324:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.642364:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098650496:0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.642389:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.642407:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098651008:0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.642433:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.642455:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098651520:0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.642475:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.642495:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788483003.642502:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098651136:0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.642523:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.642540:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098651648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483003.642563:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.642590:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098650496 00000100:00100000:1.0:1788483003.642594:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098650496 00000100:00100000:1.0:1788483003.642622:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788483003.642629:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098650496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.642667:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098650496:12345-0@lo:400:kworker.0 Request processed in 38us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.642674:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788483003.642694:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651648 00000100:00100000:1.0:1788483003.642697:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651648 00000100:00100000:1.0:1788483003.642726:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788483003.642742:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098651648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483003.642763:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483003.642794:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098651648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.642800:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788483003.642815:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483003.642825:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651136 00000100:00100000:1.0:1788483003.642828:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651136 00000100:00100000:1.0:1788483003.642855:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788483003.642861:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098651136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.642907:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098651136:12345-0@lo:400:kworker.0 Request processed in 47us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.642914:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1788483003.642930:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483003.642948:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098651136:0@lo:400:kworker.0 00010000:00080000:1.0:1788483003.642960:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3769f80 x1875360098651648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483003.642974:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098651648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483003.642985:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098650496:0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.643018:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651008 00000100:00100000:1.0:1788483003.643022:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651008 00000100:00100000:1.0:1788483003.643049:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651520 00000100:00100000:1.0:1788483003.643052:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651520 00000100:00100000:1.0:1788483003.643069:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788483003.643076:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098651008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.643284:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098651008:12345-0@lo:400:kworker.0 Request processed in 207us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.643298:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788483003.643311:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788483003.643317:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098651520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.643347:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098651520:12345-0@lo:400:kworker.0 Request processed in 31us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.643353:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788483003.643370:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788483003.643386:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f7800 x1875360098651008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483003.643396:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098651008:0@lo:400:kworker.0 00010000:00080000:1.0:1788483003.643405:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376ed80 x1875360098651520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483003.643414:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098651520:0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.643915:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098649984 00000100:00100000:0.0:1788483003.643921:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098649984 00000100:00100000:0.0:1788483003.643962:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788483003.643970:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098649984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.644011:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098649984:12345-0@lo:400:kworker.0 Request processed in 42us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483003.644018:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788483003.647530:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098649984:0@lo:400:kworker.0 00000100:00100000:2.0:1788483003.649381:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483003.649428:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098650624:0@lo:400:kworker.0 00000100:00100000:2.0:1788483003.649460:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.650250:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098650112 00000100:00100000:1.0:1788483003.650260:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098650112 00000100:00100000:1.0:1788483003.650315:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098650624 00000100:00100000:1.0:1788483003.650318:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098650624 00000100:00100000:1.0:1788483003.650356:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788483003.650365:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098650112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.650437:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098650112:12345-0@lo:400:kworker.0 Request processed in 74us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.650445:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788483003.650461:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788483003.650480:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098650624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.650513:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098650624:12345-0@lo:400:kworker.0 Request processed in 34us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.650518:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1788483003.650541:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483003.650903:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f4757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098650112:0@lo:400:kworker.0 00000100:00100000:2.0:1788483003.650917:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098650624:0@lo:400:kworker.0 00000100:00100000:3.0:1788483003.655088:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483003.655172:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098650880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483003.655208:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483003.655239:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098651392:0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.655248:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098650368 00000100:00100000:1.0:1788483003.655257:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098650368 00000100:00100000:3.0:1788483003.655260:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483003.655356:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788483003.655369:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098650368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483003.655418:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098650368:12345-0@lo:400:kworker.0 Request processed in 52us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483003.655424:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788483003.656659:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098650368:0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.661128:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098650880 00000100:00100000:0.0:1788483003.661144:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098650880 00000100:00100000:0.0:1788483003.661265:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651392 00000100:00100000:0.0:1788483003.661269:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651392 00000100:00100000:3.0:1788483003.661322:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788483003.661334:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098650880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483003.661447:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098650880:12345-0@lo:400:kworker.0 Request processed in 115us (6237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483003.661454:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1788483003.661499:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f4e00 x1875360098650880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483003.661514:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098650880:0@lo:400:kworker.0 00000100:00080000:1.0:1788483003.665769:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483003.665780:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483003.668773:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788483003.668879:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098651392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.668983:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098651392:12345-0@lo:400:kworker.0 Request processed in 112us (13720us total) trans 0 rc 0/0 00010000:00080000:1.0:1788483003.669053:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376ce00 x1875360098651392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483003.669067:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098651392:0@lo:400:kworker.0 00000100:00100000:0.0:1788483003.683598:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788483004.153727:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098651776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483004.153819:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483004.153938:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651776 00000100:00100000:0.0:1788483004.153946:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651776 00000100:00100000:0.0:1788483004.154013:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788483004.154022:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098651776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483004.154043:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483004.154087:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098651776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483004.154117:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788483004.154268:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376c000 x1875360098651776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483004.154286:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098651776:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788483004.540369:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483005.179223:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788483005.179247:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098652032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483005.179309:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483005.179370:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098651904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483005.179395:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483005.179428:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098652032 00000100:00100000:0.0:1788483005.179435:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098652032 00000100:00100000:0.0:1788483005.179484:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098651904 00000100:00100000:0.0:1788483005.179488:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098651904 00000100:00100000:2.0:1788483005.179502:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788483005.179519:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098652032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483005.179547:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483005.179593:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098652032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00080000:1.0:1788483005.182170:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483005.182948:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788483005.182965:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098651904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483005.182992:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483005.183062:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098651904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483005.183070:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788483005.183166:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098652160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483005.183202:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483005.183249:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098652160 00000100:00100000:0.0:1788483005.183255:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098652160 00000100:00100000:0.0:1788483005.183300:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788483005.183308:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098652160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483005.183336:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788483005.183371:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098652160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483005.183377:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788483005.183392:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788483005.183414:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098652160:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788483005.183657:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3c78e00 x1875360098652032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483005.183679:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098652032:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788483005.183694:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376c000 x1875360098651904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483005.183706:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098651904:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788483005.561121:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483006.586896:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483006.613323:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483006.613458:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483006.613488:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483006.613523:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483006.613552:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483006.613588:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087033984 00000100:00100000:1.0:1788483006.613600:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087033984 00000100:00100000:1.0:1788483006.613663:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 315 00000100:00100000:1.0:1788483006.613674:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2392:x1875360087033984:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483006.613766:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2392:x1875360087033984:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 93us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483006.613775:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 315 00000100:00100000:1.0:1788483006.613818:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087034240 00000100:00100000:1.0:1788483006.613822:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087034240 00000100:00100000:1.0:1788483006.613855:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087034496 00000100:00100000:1.0:1788483006.613858:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087034496 00000100:00100000:1.0:1788483006.613872:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087034112 00000100:00100000:1.0:1788483006.613875:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087034112 00000100:00100000:1.0:1788483006.613888:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087034368 00000100:00100000:1.0:1788483006.613890:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087034368 00000100:00100000:1.0:1788483006.613905:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 189 00000100:00100000:1.0:1788483006.613912:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087034240:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483006.613949:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087034240:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 37us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483006.613955:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 189 00000100:00100000:1.0:1788483006.613966:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 190 00000100:00100000:1.0:1788483006.613972:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087034496:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483006.613993:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087034496:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483006.613999:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 190 00000100:00100000:1.0:1788483006.614020:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 191 00000100:00100000:1.0:1788483006.614026:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087034112:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483006.614052:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087034112:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483006.614058:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 191 00000100:00100000:1.0:1788483006.614069:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 192 00000100:00100000:1.0:1788483006.614168:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087034368:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483006.614195:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087034368:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483006.614201:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 192 00000100:00080000:1.0:1788483006.614385:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483006.614391:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1788483006.751456:0:13162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda08ee810 20000000:00000080:3.0:1788483006.751479:0:13162:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a68c33b4800 uarg=0000000000000000 20000000:01000000:3.0:1788483006.751553:0:13162:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788483006.751562:0:13162:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788483006.751568:0:13162:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788483006.752734:0:13163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788483006.752942:0:13162:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788483006.759508:0:13162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788483006.759549:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759573:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759584:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759592:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759599:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759606:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759613:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759620:0:13162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759674:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759712:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 12 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.759729:0:13162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652288:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483006.759989:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.759998:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 23 pid: 6486 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.760008:0:13162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652416:0@lo:104: 00000100:00100000:3.0:1788483006.760057:0:13162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788483006.760093:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.760133:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 23 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.760151:0:13162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652544:0@lo:104: 00000100:00100000:3.0:1788483006.760175:0:13162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788483006.760655:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.760666:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 23 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.760675:0:13162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652672:0@lo:104: 00000100:00100000:3.0:1788483006.760701:0:13162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788483006.760791:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.760800:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 23 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.760809:0:13162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652800:0@lo:104: 00000100:00100000:3.0:1788483006.760831:0:13162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788483006.761685:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.761700:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 12 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.761711:0:13162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652928:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483006.761767:0:13162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6176b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483006.762008:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098652416 00000100:00100000:2.0:1788483006.762017:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098652416 00000100:00100000:2.0:1788483006.762070:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098652544 00000100:00100000:2.0:1788483006.762073:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098652544 00000100:00100000:2.0:1788483006.762085:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098652672 00000100:00100000:2.0:1788483006.762087:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098652672 00000100:00100000:2.0:1788483006.762129:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098652800 00000100:00100000:2.0:1788483006.762132:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098652800 00000100:00100000:2.0:1788483006.762161:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788483006.762171:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:13162:x1875360098652416:12345-0@lo:104: 00010000:00010000:2.0:1788483006.762562:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.762730:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483006.762738:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:13162:x1875360098652416:12345-0@lo:104: Request processed in 568us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.762747:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483006.762773:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788483006.762781:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:13162:x1875360098652544:12345-0@lo:104: 00010000:00010000:3.0:1788483006.762789:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.762826:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788483006.762831:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:13162:x1875360098652544:12345-0@lo:104: Request processed in 53us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.762838:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788483006.762858:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788483006.762865:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:13162:x1875360098652672:12345-0@lo:104: 00010000:00010000:3.0:1788483006.762874:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.762912:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788483006.762917:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:13162:x1875360098652672:12345-0@lo:104: Request processed in 53us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.762922:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788483006.762934:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788483006.762941:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:13162:x1875360098652800:12345-0@lo:104: 00010000:00010000:3.0:1788483006.762949:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.762977:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788483006.762982:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:13162:x1875360098652800:12345-0@lo:104: Request processed in 43us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.762988:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788483006.763009:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788483006.763016:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763024:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483006.763028:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763038:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483006.763057:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483006.763063:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483006.763134:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763151:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483006.763176:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763394:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1a63a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a641 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763410:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788483006.763414:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763420:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483006.763424:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763430:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483006.763436:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483006.763441:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483006.763464:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763471:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483006.763491:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763498:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1a62c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a633 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763508:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483006.763511:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763517:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b000 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483006.763519:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763526:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483006.763532:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483006.763538:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483006.763551:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763556:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483006.763562:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763578:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1a61e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a625 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763588:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483006.763591:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763596:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483006.763599:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763605:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483006.763611:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483006.763616:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483006.763629:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763634:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483006.763639:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763645:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a610 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a617 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.763659:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483006.763667:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483006.763669:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483006.763698:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098653056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483006.763747:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483006.763793:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483006.763799:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098653440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483006.763821:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483006.763852:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098653184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483006.763877:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483006.763896:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483006.763900:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098653312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483006.763923:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483006.763950:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653056 00000100:00100000:3.0:1788483006.763957:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653056 00010000:00010000:3.0:1788483006.763988:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 24 pid: 6486 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.764008:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653440 00000100:00100000:3.0:1788483006.764011:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653440 00010000:00010000:3.0:1788483006.764022:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 25 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.764031:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653184 00000100:00100000:3.0:1788483006.764034:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653184 00010000:00010000:3.0:1788483006.764042:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 26 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.764051:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653312 00000100:00100000:3.0:1788483006.764054:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653312 00010000:00010000:3.0:1788483006.764063:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 27 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.764083:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788483006.764090:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+27:3622:x1875360098653056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483006.764266:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483006.764273:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 27 pid: 6486 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764284:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 27 pid: 6486 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764304:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483006.764336:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+27:3622:x1875360098653056:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.764343:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788483006.764360:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483006.764365:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+26:3622:x1875360098653440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483006.764390:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483006.764395:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 26 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764403:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 26 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764413:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483006.764435:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+26:3622:x1875360098653440:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.764441:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483006.764453:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788483006.764465:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:3619:x1875360098653184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483006.764473:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483006.764477:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 25 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764485:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 25 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764495:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483006.764522:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:3619:x1875360098653184:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.764528:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788483006.764540:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483006.764546:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098653312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483006.764554:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483006.764558:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 24 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764565:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 24 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.764574:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483006.764594:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098653312:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.764599:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483006.764651:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098653312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483006.764660:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098653184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483006.764693:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098653440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483006.764709:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098653056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483006.764807:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483006.764816:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483006.764848:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a641 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a63a expref: 23 pid: 6486 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483006.764863:0:13162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652416:0@lo:104: 00010000:00010000:2.0:1788483006.764874:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030400/0x1d7ea3d89ea1a633 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a62c expref: 22 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483006.764910:0:13162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652544:0@lo:104: 00010000:00010000:2.0:1788483006.764924:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a625 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a61e expref: 21 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483006.764933:0:13162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652672:0@lo:104: 00010000:00010000:2.0:1788483006.764942:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a617 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a610 expref: 20 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483006.764954:0:13162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652800:0@lo:104: 00000100:00100000:1.0:1788483006.766052:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483006.766237:0:13162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652288:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483006.766611:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087034624 00000100:00100000:3.0:1788483006.766620:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087034624 00010000:00010000:3.0:1788483006.766659:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 13 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.766734:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:3.0:1788483006.766746:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087034624:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483006.766764:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483006.766771:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 13 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.766783:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 13 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.766801:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a656 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e19d expref: 13 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.766815:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483006.766881:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c71c064-eed6-492d-871f-d947c33908cf+12:2393:x1875360087034624:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 135us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.766888:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:2.0:1788483006.771494:0:13162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875360098652928:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483006.771575:0:13162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483006.772769:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483006.772971:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087034752 00000100:00100000:3.0:1788483006.772983:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087034752 00010000:00010000:3.0:1788483006.773035:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 12 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483006.773238:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:3.0:1788483006.773270:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0008450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+12:2392:x1875360087034752:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483006.773290:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483006.773297:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 12 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773311:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 12 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773332:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a609 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e15e expref: 12 pid: 6486 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773351:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773360:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773379:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773387:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773393:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773400:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773406:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483006.773413:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773427:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773450:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.773461:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483006.773533:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0008450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+11:2392:x1875360087034752:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 261us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.773542:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 45 00010000:00010000:2.0:1788483006.773650:0:13162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483006.773659:0:13162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483006.773666:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1a679 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483007.608560:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483007.736868:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098653568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483007.736963:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483007.737086:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653568 00000100:00100000:0.0:1788483007.737112:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653568 00000100:00100000:0.0:1788483007.737227:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788483007.737239:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098653568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483007.737289:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788483007.741205:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098653568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3943us (4217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483007.741225:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788483007.741531:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098653568:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1788483007.992186:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788483007.992197:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c1c41000 from 7 10000000:01000000:3.0:1788483007.992204:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483007.992262:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483007.992276:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483007.992289:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483007.992321:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098653696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483007.992410:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483007.992480:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483007.994720:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653696 00000100:00100000:0.0:1788483007.994736:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653696 00000100:00100000:0.0:1788483007.994812:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788483007.994824:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098653696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483007.994840:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483007.994863:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a680 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483007.994894:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483007.994907:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483007.994936:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9c00, rc 0) 00000100:00100000:0.0:1788483007.995014:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098653696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483007.995021:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788483007.995156:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098653696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483007.995187:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483007.995210:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483007.995320:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098653824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483007.995379:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483007.995431:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace780 going to sleep for 11 seconds 00000100:00100000:2.0:1788483007.996261:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653824 00000100:00100000:2.0:1788483007.996271:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653824 00000100:00100000:2.0:1788483007.996323:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788483007.996333:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098653824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483007.996503:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098653824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483007.996513:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788483007.996540:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098653824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483007.996600:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098653952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483007.996680:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483007.996716:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace780 going to sleep for 11 seconds 00000100:00100000:2.0:1788483007.996803:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098653952 00000100:00100000:2.0:1788483007.996811:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098653952 00000100:00100000:2.0:1788483007.996845:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788483007.996853:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098653952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483007.996971:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098653952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483007.996979:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788483007.997345:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098653952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788483008.001265:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788483008.001375:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788483008.001426:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483008.001441:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.001457:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483008.001471:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483008.001475:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69e00f6800 from 7 10000000:01000000:1.0:1788483008.001478:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483008.001536:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.001563:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.001577:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483008.001612:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.001716:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.001780:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483008.007591:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654080 00000100:00100000:3.0:1788483008.007607:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654080 00000100:00100000:3.0:1788483008.007672:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788483008.007682:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098654080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483008.007697:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483008.007715:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a68e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483008.007743:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483008.007755:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483008.007782:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76600, rc 0) 00000100:00100000:3.0:1788483008.007858:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098654080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (6143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.007865:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788483008.009517:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483008.009557:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.009573:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483008.009887:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.009958:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483008.010207:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654208 00000100:00100000:3.0:1788483008.010217:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654208 00000100:00100000:1.0:1788483008.013791:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483008.013945:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788483008.013973:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098654208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483008.014743:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098654208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 783us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.014753:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788483008.014912:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.014983:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.015616:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.015765:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483008.015877:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654336 00000100:00100000:3.0:1788483008.015887:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654336 00000100:00100000:3.0:1788483008.015952:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788483008.015961:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098654336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483008.018564:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098654336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2579us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.018583:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788483008.019519:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788483008.021249:0:13189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788483008.021344:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788483008.021403:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483008.021439:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.021454:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483008.021468:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483008.021471:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69c5051000 from 7 10000000:01000000:1.0:1788483008.021475:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483008.021520:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.021529:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.021551:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483008.021584:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.022403:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.022486:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483008.022529:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654464 00000100:00100000:3.0:1788483008.022576:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654464 00000100:00100000:3.0:1788483008.022738:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788483008.022751:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098654464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483008.022769:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483008.022785:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a69c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483008.022844:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483008.022856:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483008.022866:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76800, rc 0) 00000100:00100000:3.0:1788483008.022918:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098654464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.022925:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788483008.023052:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483008.023068:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.023078:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483008.023194:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.023241:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.023533:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483008.023603:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654592 00000100:00100000:0.0:1788483008.023610:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654592 00000100:00100000:0.0:1788483008.023697:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788483008.023706:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098654592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483008.024359:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098654592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 652us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.024370:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788483008.024480:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.024521:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.024685:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.024737:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483008.024765:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654720 00000100:00100000:0.0:1788483008.024771:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654720 00000100:00100000:0.0:1788483008.024881:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788483008.024888:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098654720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483008.024986:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098654720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.024992:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788483008.025093:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788483008.025867:0:13190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788483008.025943:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788483008.025969:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483008.025982:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.025995:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483008.026007:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483008.026010:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d20cc000 from 7 10000000:01000000:1.0:1788483008.026013:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483008.026062:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.026070:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.026080:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483008.026143:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.026209:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.026928:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483008.027298:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654848 00000100:00100000:0.0:1788483008.027308:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654848 00000100:00100000:0.0:1788483008.027356:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788483008.027367:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098654848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483008.027400:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483008.027419:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a6aa expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483008.027449:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483008.027460:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483008.027471:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8a00, rc 0) 00000100:00100000:1.0:1788483008.027771:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483008.027790:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.027811:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483008.027912:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.027968:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483008.030445:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098654976 00000100:00100000:2.0:1788483008.030458:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098654976 00000100:00100000:2.0:1788483008.030868:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788483008.030881:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:6491:x1875360098654976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483008.031317:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:6491:x1875360098654976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 438us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483008.031325:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788483008.031778:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483008.031839:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098654976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.031912:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098655104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483008.032730:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.032805:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483008.032822:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098655104 00000100:00100000:2.0:1788483008.032835:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098655104 00000100:00100000:2.0:1788483008.032874:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788483008.032882:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:6491:x1875360098655104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483008.032972:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:6491:x1875360098654848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5603us (6760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.032982:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788483008.033086:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098655104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483008.033122:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788483008.033776:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098655104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788483008.037202:0:13191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788483008.040623:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788483008.040664:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483008.040677:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483008.040690:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483008.594454:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483008.598012:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087034880 00000100:00100000:0.0:1788483008.598036:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087034880 00000100:00100000:0.0:1788483008.598961:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 328 00000100:00100000:0.0:1788483008.598982:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+11:6166:x1875360087034880:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483008.599006:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483008.599031:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1ce expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483008.599083:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483008.599123:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483008.599143:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9e00, rc 0) 00000100:00100000:0.0:1788483008.599243:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087034880:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 269us (4803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.599257:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 328 00000100:00100000:1.0:1788483008.606511:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483008.606650:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035008 00000100:00100000:3.0:1788483008.606664:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035008 00000100:00100000:3.0:1788483008.606734:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 329 00000100:00100000:3.0:1788483008.606745:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087035008:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483008.606938:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087035008:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 195us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.606947:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 329 00000100:00100000:3.0:1788483008.608939:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483008.608989:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035136 00000100:00100000:3.0:1788483008.609001:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035136 00000100:00100000:3.0:1788483008.609048:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 330 00000100:00100000:3.0:1788483008.609059:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087035136:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483008.611841:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087035136:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 2766us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.611858:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 330 00000100:00100000:3.0:1788483008.621494:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483008.621655:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035264 00000100:00100000:1.0:1788483008.621670:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035264 00000100:00100000:1.0:1788483008.621753:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 331 00000100:00100000:1.0:1788483008.621766:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087035264:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483008.621789:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483008.621812:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1d5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.621865:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.621877:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483008.621887:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b800, rc 0) 00000100:00100000:1.0:1788483008.621955:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087035264:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 192us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483008.621963:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 331 00000100:00100000:1.0:1788483008.624672:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483008.624834:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035392 00000100:00100000:3.0:1788483008.624851:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035392 00000100:00100000:3.0:1788483008.624963:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 332 00000100:00100000:3.0:1788483008.624976:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087035392:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483008.625213:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087035392:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 239us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.625224:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 332 00000100:00100000:0.0:1788483008.627692:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483008.627877:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035520 00000100:00100000:3.0:1788483008.627890:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035520 00000100:00100000:3.0:1788483008.627998:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 333 00000100:00100000:3.0:1788483008.628010:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087035520:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483008.628263:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087035520:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 253us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483008.628273:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 333 00010000:00010000:3.0:1788483008.632854:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483008.760669:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098655232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483008.760808:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.761054:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098655232 00000100:00100000:1.0:1788483008.761064:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098655232 00000100:00100000:1.0:1788483008.761592:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788483008.761609:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098655232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483008.761651:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483008.761734:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098655232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483008.761742:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788483008.761989:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098655488:0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.762034:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483008.762057:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098656000:0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.762075:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788483008.762199:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788483008.762239:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098655488 00000100:00100000:0.0:1788483008.762309:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098655488 00000100:00100000:0.0:1788483008.762348:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656000 00000100:00100000:0.0:1788483008.762351:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656000 00000100:00100000:0.0:1788483008.762378:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788483008.762460:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098655488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.762511:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098655488:12345-0@lo:400:kworker.0 Request processed in 55us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.762518:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788483008.762977:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788483008.762987:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098656000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.763027:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098656000:12345-0@lo:400:kworker.0 Request processed in 44us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.763034:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788483008.763092:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098655616:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.763229:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098655360:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.763627:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.763671:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098655872:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.763697:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.763729:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098656384:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.763752:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483008.763890:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483008.763912:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098656128:0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.763934:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483008.763948:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098656640:0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.763965:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483008.763999:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656128 00000100:00100000:0.0:1788483008.764006:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656128 00000100:00100000:0.0:1788483008.764040:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656640 00000100:00100000:0.0:1788483008.764043:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656640 00000100:00100000:0.0:1788483008.764060:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788483008.764067:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098656128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.764227:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098656000:0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.764236:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098656512:0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.764447:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483008.764492:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098655488:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.764608:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788483008.764621:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098655744:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.764651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.764665:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098656256:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.764684:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483008.764704:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098656768:0@lo:400:kworker.0 00010000:00080000:2.0:1788483008.765216:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca4000 x1875360098655232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483008.765370:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098656128:12345-0@lo:400:kworker.0 Request processed in 1300us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483008.765515:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098655232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483008.765649:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656384 00000100:00100000:2.0:1788483008.765658:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656384 00000100:00100000:2.0:1788483008.765736:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656256 00000100:00100000:2.0:1788483008.765740:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656256 00000100:00100000:2.0:1788483008.765766:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788483008.765776:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098656384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.765860:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098656384:12345-0@lo:400:kworker.0 Request processed in 86us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483008.765879:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788483008.765895:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788483008.765901:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098656256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.765927:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098656256:12345-0@lo:400:kworker.0 Request processed in 27us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483008.765932:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788483008.765997:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098655872 00000100:00100000:2.0:1788483008.766001:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098655872 00000100:00100000:2.0:1788483008.766023:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098655616 00000100:00100000:2.0:1788483008.766025:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098655616 00000100:00100000:2.0:1788483008.766037:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788483008.766042:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098655872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.766491:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483008.766610:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788483008.766638:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656512 00000100:00100000:0.0:1788483008.766642:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656512 00000100:00100000:0.0:1788483008.766664:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098655744 00000100:00100000:0.0:1788483008.766668:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098655744 00000100:00100000:0.0:1788483008.766680:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788483008.766687:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098656640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.766729:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098656640:12345-0@lo:400:kworker.0 Request processed in 42us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.766735:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788483008.766747:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788483008.766753:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098656512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.766812:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098656512:12345-0@lo:400:kworker.0 Request processed in 60us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.766825:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788483008.766837:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788483008.766843:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098655744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.766872:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098655744:12345-0@lo:400:kworker.0 Request processed in 29us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.766878:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788483008.766901:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788483008.766909:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098655616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.766940:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098655616:12345-0@lo:400:kworker.0 Request processed in 32us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483008.766946:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788483008.766992:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098655616:0@lo:400:kworker.0 00010000:00080000:0.0:1788483008.767010:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3c78a80 x1875360098656128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483008.767022:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098656128:0@lo:400:kworker.0 00010000:00080000:0.0:1788483008.767034:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376a300 x1875360098656640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483008.767043:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098656640:0@lo:400:kworker.0 00000100:00100000:0.0:1788483008.767082:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098656512:0@lo:400:kworker.0 00010000:00080000:1.0:1788483008.767208:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f53b80 x1875360098656384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483008.767218:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098656384:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.767238:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098655744:0@lo:400:kworker.0 00010000:00080000:1.0:1788483008.767374:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f53800 x1875360098656256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483008.767685:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483008.767693:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483008.767696:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483008.767707:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098656256:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.767743:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098655360 00000100:00100000:1.0:1788483008.767749:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098655360 00000100:00100000:1.0:1788483008.767801:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788483008.767809:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098655360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.767862:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098655360:12345-0@lo:400:kworker.0 Request processed in 54us (4236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483008.767869:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788483008.767909:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656768 00000100:00100000:1.0:1788483008.767915:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656768 00000100:00100000:1.0:1788483008.767951:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788483008.767958:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098656768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.767999:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098656768:12345-0@lo:400:kworker.0 Request processed in 42us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483008.768005:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788483008.768027:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788483008.768043:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376c000 x1875360098656768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483008.768053:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098656768:0@lo:400:kworker.0 00000100:00100000:1.0:1788483008.768063:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098655360:0@lo:400:kworker.0 00000100:00100000:2.0:1788483008.768492:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098655872:12345-0@lo:400:kworker.0 Request processed in 2447us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483008.768500:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788483008.768655:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098655872:0@lo:400:kworker.0 00000100:00100000:2.0:1788483009.278055:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098656896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483009.278173:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483009.291197:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098656896 00000100:00100000:2.0:1788483009.291218:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098656896 00000100:00100000:2.0:1788483009.291302:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788483009.291314:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098656896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788483009.291347:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483009.291457:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098656896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (13283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483009.291482:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788483009.291744:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f6d80 x1875360098656896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483009.291768:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098656896:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788483009.667731:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483010.298982:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098657024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483010.299084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483010.299201:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483010.299208:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098657152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483010.299273:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483010.299313:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657152 00000100:00100000:1.0:1788483010.299324:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657152 00000100:00100000:1.0:1788483010.299384:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788483010.299395:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098657152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483010.299448:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483010.299499:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098657152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483010.299508:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788483010.299968:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098657280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483010.300011:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483010.300059:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657024 00000100:00100000:3.0:1788483010.300065:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657024 00000100:00100000:3.0:1788483010.300148:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657280 00000100:00100000:3.0:1788483010.300152:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657280 00000100:00100000:3.0:1788483010.300173:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788483010.300181:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098657024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483010.300218:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483010.300258:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098657024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483010.300266:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788483010.300284:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788483010.300290:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098657280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483010.300302:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483010.300329:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098657280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483010.300334:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788483010.300350:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788483010.300383:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37fad80 x1875360098657280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483010.300405:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098657280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483010.301302:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098657152:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788483010.301333:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f14380 x1875360098657024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483010.301381:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098657024:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788483010.681436:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788483011.550765:0:13361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788483011.707242:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483011.725684:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483011.726324:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483011.726356:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483011.726379:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483011.726406:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483011.726443:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035904 00000100:00100000:0.0:1788483011.726456:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035904 00000100:00100000:0.0:1788483011.726532:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036160 00000100:00100000:0.0:1788483011.726536:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036160 00000100:00100000:0.0:1788483011.726550:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035776 00000100:00100000:0.0:1788483011.726553:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035776 00000100:00100000:0.0:1788483011.726564:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036032 00000100:00100000:0.0:1788483011.726566:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036032 00000100:00100000:0.0:1788483011.726582:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 199 00000100:00100000:0.0:1788483011.726592:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087035904:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483011.726682:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087035904:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483011.726689:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 199 00000100:00100000:0.0:1788483011.726708:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 200 00000100:00100000:0.0:1788483011.726715:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036160:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483011.726739:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036160:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483011.726745:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 200 00000100:00100000:0.0:1788483011.726757:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 201 00000100:00100000:0.0:1788483011.726763:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087035776:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483011.726804:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087035776:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483011.726818:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 201 00000100:00100000:0.0:1788483011.726830:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 202 00000100:00100000:0.0:1788483011.726837:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036032:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483011.726861:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036032:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483011.726868:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 202 00000100:00080000:0.0:1788483011.726907:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483011.726912:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483011.733092:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087035648 00000100:00100000:1.0:1788483011.733414:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087035648 00000100:00100000:1.0:1788483011.733489:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 335 00000100:00100000:1.0:1788483011.733501:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087035648:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483011.734149:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087035648:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 647us (8476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483011.734159:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 335 00010000:00010000:0.0:1788483012.733690:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483012.857278:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098657408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483012.857371:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483012.857471:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657408 00000100:00100000:1.0:1788483012.857481:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657408 00000100:00100000:1.0:1788483012.857537:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788483012.857548:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098657408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483012.857590:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788483012.857643:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098657408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483012.857651:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788483012.857708:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098657408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788483013.755863:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483013.880550:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483013.880594:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098657536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483013.880697:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483013.880898:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657536 00000100:00100000:1.0:1788483013.880912:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657536 00000100:00100000:1.0:1788483013.880994:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788483013.881007:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098657536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483013.881062:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483013.881182:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098657536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483013.881190:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1788483013.881256:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca5500 x1875360098657536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483013.881279:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098657536:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788483013.881712:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483013.882020:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098657920:0@lo:400:kworker.0 00000100:00100000:3.0:1788483013.882204:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098657664:0@lo:400:kworker.0 00000100:00100000:3.0:1788483013.882241:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483013.882275:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098658176:0@lo:400:kworker.0 00000100:00100000:3.0:1788483013.882317:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657664 00000100:00100000:3.0:1788483013.882324:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657664 00000100:00100000:3.0:1788483013.882369:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788483013.882385:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098657664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483013.882431:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098657664:12345-0@lo:400:kworker.0 Request processed in 47us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483013.882439:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788483013.882538:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098658048:0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.882588:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483013.882628:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098658560:0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.882654:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483013.882674:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098659072:0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.882696:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483013.882806:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658560 00000100:00100000:2.0:1788483013.882811:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658560 00000100:00100000:2.0:1788483013.882848:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659072 00000100:00100000:2.0:1788483013.882852:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659072 00000100:00100000:2.0:1788483013.882877:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788483013.882884:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098658560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.882925:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098658560:12345-0@lo:400:kworker.0 Request processed in 42us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.882932:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788483013.882944:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788483013.882950:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098659072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.882978:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098659072:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.882984:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1788483013.883020:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae0000 x1875360098658560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483013.883035:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098658560:0@lo:400:kworker.0 00010000:00080000:2.0:1788483013.883057:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae2a00 x1875360098659072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483013.883065:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098659072:0@lo:400:kworker.0 00000100:00100000:3.0:1788483013.883236:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658048 00000100:00100000:3.0:1788483013.883241:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658048 00000100:00100000:3.0:1788483013.883271:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788483013.883279:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098658048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483013.883328:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098658048:12345-0@lo:400:kworker.0 Request processed in 50us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483013.883335:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1788483013.883354:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483013.883359:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483013.883744:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098658048:0@lo:400:kworker.0 00000100:00100000:0.0:1788483013.883826:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098657792:0@lo:400:kworker.0 00000100:00100000:0.0:1788483013.883873:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483013.883905:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098658304:0@lo:400:kworker.0 00000100:00100000:0.0:1788483013.883928:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483013.883951:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098658816:0@lo:400:kworker.0 00000100:00100000:0.0:1788483013.883973:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483013.884008:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657792 00000100:00100000:0.0:1788483013.884013:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657792 00000100:00100000:0.0:1788483013.884036:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658304 00000100:00100000:0.0:1788483013.884039:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658304 00000100:00100000:0.0:1788483013.884063:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658816 00000100:00100000:0.0:1788483013.884066:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658816 00000100:00100000:0.0:1788483013.884492:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788483013.884704:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483013.884750:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098658432:0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.884784:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483013.884796:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098658944:0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.884815:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483013.884851:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098657920 00000100:00100000:1.0:1788483013.884856:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098657920 00000100:00100000:1.0:1788483013.884889:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788483013.884898:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098657920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.884952:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098657920:12345-0@lo:400:kworker.0 Request processed in 56us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483013.884960:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788483013.884998:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098657920:0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.885029:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658432 00000100:00100000:1.0:1788483013.885033:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658432 00000100:00100000:0.0:1788483013.885167:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098657792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483013.885208:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098657792:12345-0@lo:400:kworker.0 Request processed in 44us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.885273:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658944 00000100:00100000:2.0:1788483013.885278:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658944 00000100:00100000:1.0:1788483013.886225:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788483013.886241:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098658304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.886310:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098658304:12345-0@lo:400:kworker.0 Request processed in 76us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483013.886318:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788483013.886337:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788483013.886344:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098658816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.886370:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098658816:12345-0@lo:400:kworker.0 Request processed in 27us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483013.886376:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788483013.886387:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788483013.886393:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098658432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.886426:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098658432:12345-0@lo:400:kworker.0 Request processed in 33us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483013.886432:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:1.0:1788483013.886576:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae0a80 x1875360098658432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483013.886591:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098658432:0@lo:400:kworker.0 00000100:00080000:1.0:1788483013.886634:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483013.886640:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483013.886665:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098657792:0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.886677:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098658304:0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.886687:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098658816:0@lo:400:kworker.0 00000100:00100000:0.0:1788483013.889770:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788483013.890046:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788483013.890081:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098658944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.890299:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098658944:12345-0@lo:400:kworker.0 Request processed in 243us (5482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.890306:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788483013.891959:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483013.892035:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098658688:0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.892167:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483013.892231:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098657664:0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.892276:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658688 00000100:00100000:1.0:1788483013.892284:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658688 00000100:00100000:1.0:1788483013.892355:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788483013.892370:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098658688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483013.892422:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098658688:12345-0@lo:400:kworker.0 Request processed in 58us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483013.892430:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788483013.892455:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788483013.892483:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae1180 x1875360098658688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483013.892976:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098658688:0@lo:400:kworker.0 00010000:00080000:0.0:1788483013.893143:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae1500 x1875360098658944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483013.893159:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098658944:0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.893445:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098658176 00000100:00100000:2.0:1788483013.893453:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098658176 00000100:00100000:2.0:1788483013.893515:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788483013.893525:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098658176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483013.893626:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098658176:12345-0@lo:400:kworker.0 Request processed in 94us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.893633:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788483013.893882:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098658176:0@lo:400:kworker.0 00000100:00100000:2.0:1788483014.396271:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483014.396302:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098659200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483014.396388:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483014.396476:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659200 00000100:00100000:2.0:1788483014.396486:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659200 00000100:00100000:2.0:1788483014.396547:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788483014.396559:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098659200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788483014.396615:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483014.396669:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098659200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483014.396679:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788483014.396725:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f16a00 x1875360098659200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483014.396747:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098659200:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788483014.776385:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483015.420663:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098659328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483015.420757:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483015.420850:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659328 00000100:00100000:1.0:1788483015.420859:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659328 00000100:00100000:1.0:1788483015.420934:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788483015.420946:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098659328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788483015.420986:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483015.421036:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098659328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483015.421043:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788483015.421069:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788483015.421128:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae1180 x1875360098659328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483015.421170:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098659328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483015.422689:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098659456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483015.423027:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483015.423132:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659456 00000100:00100000:2.0:1788483015.423141:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659456 00000100:00100000:2.0:1788483015.423269:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788483015.423280:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098659456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483015.423307:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483015.423354:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098659456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.423362:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788483015.423384:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788483015.423414:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f16a00 x1875360098659456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483015.423436:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098659456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483015.426390:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483015.426424:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098659584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483015.426585:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483015.426722:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659584 00000100:00100000:0.0:1788483015.426731:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659584 00000100:00100000:0.0:1788483015.426793:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788483015.426804:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098659584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483015.426848:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788483015.426907:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098659584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483015.426915:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788483015.426963:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098659584:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788483015.805814:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483016.826692:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483016.854130:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483016.854207:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483016.854248:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483016.854273:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483016.854315:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483016.854350:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036416 00000100:00100000:0.0:1788483016.854363:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036416 00000100:00100000:0.0:1788483016.854431:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036672 00000100:00100000:0.0:1788483016.854435:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036672 00000100:00100000:0.0:1788483016.854451:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036544 00000100:00100000:0.0:1788483016.854454:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036544 00000100:00100000:0.0:1788483016.854490:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036800 00000100:00100000:0.0:1788483016.854494:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036800 00000100:00100000:0.0:1788483016.854514:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 209 00000100:00100000:0.0:1788483016.854526:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087036416:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483016.854626:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087036416:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 102us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483016.854636:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 209 00000100:00100000:0.0:1788483016.854659:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 210 00000100:00100000:0.0:1788483016.854666:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036672:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483016.854693:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036672:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483016.854700:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 210 00000100:00100000:0.0:1788483016.854713:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 211 00000100:00100000:0.0:1788483016.854720:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087036544:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483016.855411:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087036544:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 687us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483016.855421:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 211 00000100:00100000:0.0:1788483016.855443:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 212 00000100:00100000:0.0:1788483016.855453:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036800:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483016.855481:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087036800:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 31us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483016.855488:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 212 00000100:00100000:0.0:1788483016.855513:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036288 00000100:00100000:0.0:1788483016.855519:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036288 00000100:00100000:0.0:1788483016.855584:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 337 00000100:00100000:0.0:1788483016.855591:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087036288:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483016.855619:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087036288:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483016.855627:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 337 00000100:00080000:0.0:1788483016.855665:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483016.855671:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788483017.414469:0:13510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:50:14 (1788483014) === 00000100:00100000:3.0:1788483017.584519:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483017.584666:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087036928 00000100:00100000:0.0:1788483017.584681:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087036928 00000100:00100000:0.0:1788483017.584761:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:0.0:1788483017.584772:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087036928:12345-192.168.206.54@tcp:41:mkdir.0 00000004:00000024:0.0:1788483017.584966:0:8434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788483017.585138:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087036928:12345-192.168.206.54@tcp:41:mkdir.0 Request processed in 324us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483017.585150:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788483017.585274:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483017.585342:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087037056 00000100:00100000:0.0:1788483017.585351:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087037056 00000100:00100000:0.0:1788483017.585402:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:0.0:1788483017.585411:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:10490:x1875360087037056:12345-192.168.206.54@tcp:700:mkdir.0 00000100:00100000:0.0:1788483017.585486:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:10490:x1875360087037056:12345-192.168.206.54@tcp:700:mkdir.0 Request processed in 75us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483017.585493:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:3.0:1788483017.588530:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483017.589002:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087037312 00000100:00100000:2.0:1788483017.589029:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087037312 00000100:00100000:2.0:1788483017.589355:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:2.0:1788483017.589371:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:10490:x1875360087037312:12345-192.168.206.54@tcp:36:mkdir.0 00010000:00010000:2.0:1788483017.589447:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483017.589633:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a568 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e149 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.589666:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df0bf900) 00010000:00010000:2.0:1788483017.589679:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483017.589782:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.589796:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.589808:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.589850:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.589858:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.589865:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590447:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590457:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590471:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483017.590487:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041e34580 reply state 000000001dabae7d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590499:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590505:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69c591af00) 00010000:00010000:2.0:1788483017.590508:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483017.590511:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788483017.590517:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788483017.590524:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590531:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590539:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590545:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483017.590550:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590558:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590566:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69c591a600) 00010000:00010000:2.0:1788483017.590569:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483017.590579:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590585:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a6c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483017.590600:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041e34580 reply state 000000001dabae7d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590609:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.590614:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69c591a700) 00010000:00010000:2.0:1788483017.590617:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483017.590618:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788483017.590722:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:10490:x1875360087037312:12345-192.168.206.54@tcp:36:mkdir.0 Request processed in 1353us (2205us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788483017.590732:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:3.0:1788483017.608411:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.608521:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087037440 00000100:00100000:1.0:1788483017.608533:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087037440 00000100:00100000:1.0:1788483017.608601:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:1.0:1788483017.608613:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:10491:x1875360087037440:12345-192.168.206.54@tcp:101:chmod.0 00010000:00010000:1.0:1788483017.608650:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483017.608683:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a6db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1dc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.608779:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a6e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.608796:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.608810:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483017.608870:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483017.608875:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483017.608919:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.608952:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a6db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1dc expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.608993:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1dc expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.609003:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69c29d7d00) 00010000:00010000:1.0:1788483017.609006:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483017.609010:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b600, rc 0) 00000100:00100000:1.0:1788483017.609132:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:10491:x1875360087037440:12345-192.168.206.54@tcp:101:chmod.0 Request processed in 484us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.609142:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:0.0:1788483017.616552:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483017.616737:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087037696 00000100:00100000:3.0:1788483017.616750:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087037696 00000100:00100000:3.0:1788483017.616819:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:3.0:1788483017.616832:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:10491:x1875360087037696:12345-192.168.206.54@tcp:36:chmod.0 00010000:00010000:3.0:1788483017.616904:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483017.616942:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a6e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1dc expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.617302:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69c29d7d00) 00010000:00010000:3.0:1788483017.617317:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483017.617370:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.617387:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.617399:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483017.617648:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032535b0a reply state 00000000d45b5097 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.617664:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.617669:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56f00) 00010000:00010000:3.0:1788483017.617672:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788483017.617676:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788483017.617685:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788483017.617794:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:10491:x1875360087037696:12345-192.168.206.54@tcp:36:chmod.0 Request processed in 962us (1253us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788483017.617802:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:3.0:1788483017.651706:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483017.651780:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087037824 00000100:00100000:0.0:1788483017.651794:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087037824 00000100:00100000:0.0:1788483017.651864:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:0.0:1788483017.651877:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:10492:x1875360087037824:12345-192.168.206.54@tcp:101:chown.0 00010000:00010000:0.0:1788483017.651925:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483017.651953:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a6f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1e3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.652040:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a6f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.652056:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.652070:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483017.652155:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788483017.652159:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483017.652202:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.652234:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a6f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1e3 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.652251:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1e3 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.652261:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56f00) 00010000:00010000:0.0:1788483017.652264:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483017.652268:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9a00, rc 0) 00000100:00100000:0.0:1788483017.652461:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:10492:x1875360087037824:12345-192.168.206.54@tcp:101:chown.0 Request processed in 585us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483017.652469:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:0.0:1788483017.654830:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.654936:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087037952 00000100:00100000:1.0:1788483017.654948:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087037952 00000100:00100000:1.0:1788483017.655029:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:1.0:1788483017.655041:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:10492:x1875360087037952:12345-192.168.206.54@tcp:101:chown.0 00010000:00010000:1.0:1788483017.655067:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483017.655126:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a6fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1ea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655217:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655235:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655247:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655259:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655274:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655280:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655507:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a713 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655516:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655524:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483017.655572:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483017.655589:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483017.655615:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655629:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655637:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655644:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655651:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.655655:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655800:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655817:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56f00) 00010000:00010000:1.0:1788483017.655820:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.655826:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655833:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655847:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655853:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655860:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655865:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ba00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.655868:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655874:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655881:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69c591a700) 00010000:00010000:1.0:1788483017.655884:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.655886:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.655904:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a70c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.656187:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a6fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ea expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.656204:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ea expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.656213:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69c591af00) 00010000:00010000:1.0:1788483017.656216:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483017.656219:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b000, rc 0) 00000100:00100000:1.0:1788483017.656415:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:10492:x1875360087037952:12345-192.168.206.54@tcp:101:chown.0 Request processed in 1375us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.656424:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:0.0:1788483017.668272:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.668439:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087038080 00000100:00100000:1.0:1788483017.668453:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087038080 00000100:00100000:1.0:1788483017.668528:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:1.0:1788483017.668540:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:10492:x1875360087038080:12345-192.168.206.54@tcp:900:chown.0 00000100:00100000:1.0:1788483017.668649:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:10492:x1875360087038080:12345-192.168.206.54@tcp:900:chown.0 Request processed in 111us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.668658:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:1.0:1788483017.673152:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483017.673425:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087038336 00000100:00100000:0.0:1788483017.673439:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087038336 00000100:00100000:0.0:1788483017.673508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:0.0:1788483017.673520:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:10492:x1875360087038336:12345-192.168.206.54@tcp:36:chown.0 00010000:00010000:0.0:1788483017.673589:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483017.673622:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a713 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ea expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.673643:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69c591af00) 00010000:00010000:0.0:1788483017.673649:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483017.673693:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.673710:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.673722:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483017.676566:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1788483017.676702:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c873e8c reply state 000000000870af3d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.677919:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.677931:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69c591af00) 00010000:00010000:0.0:1788483017.677935:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788483017.677940:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788483017.677976:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788483017.678863:0:8434:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788483017.678883:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:10492:x1875360087038336:12345-192.168.206.54@tcp:36:chown.0 Request processed in 5361us (5738us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788483017.678892:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00010000:00010000:2.0:1788483017.679911:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.679931:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.679939:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.679946:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483017.679951:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.679977:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.679998:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69c591af00) 00010000:00010000:2.0:1788483017.680001:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788483017.680006:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.680012:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a71a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687642:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687664:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687683:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687690:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.687695:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687704:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687745:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69c591a700) 00010000:00010000:1.0:1788483017.687749:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.687754:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687760:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a6cd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687783:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687789:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687795:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687800:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.687803:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687820:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687829:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69c591af00) 00010000:00010000:1.0:1788483017.687832:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.687835:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687841:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a6d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687862:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687868:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687874:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687879:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.687882:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687888:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687896:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56f00) 00010000:00010000:1.0:1788483017.687898:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788483017.687902:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.687918:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a6e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483017.713788:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.713856:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087038464 00000100:00100000:1.0:1788483017.713881:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087038464 00000100:00100000:1.0:1788483017.713949:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:1.0:1788483017.713959:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:10493:x1875360087038464:12345-192.168.206.54@tcp:101:touch.500 00010000:00010000:1.0:1788483017.713982:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483017.714001:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1f1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483017.715366:0:6493:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1300us 00010000:00010000:1.0:1788483017.747807:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747827:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747840:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747855:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747862:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747870:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747966:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1a736 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747974:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1a736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.747981:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1a736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483017.748008:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483017.748012:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483017.748046:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1a736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748058:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748065:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748072:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748092:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ba00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.748116:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748125:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748137:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56f00) 00010000:00010000:1.0:1788483017.748146:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.748152:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748158:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748170:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748177:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748183:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748188:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.748190:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748196:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748203:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69df303800) 00010000:00010000:1.0:1788483017.748206:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.748209:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.748214:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a72f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.750773:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1f1 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.750821:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1a736 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1f1 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.750830:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483017.750833:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788483017.750837:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b400, rc 0) 00000100:00100000:1.0:1788483017.750905:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:10493:x1875360087038464:12345-192.168.206.54@tcp:101:touch.500 Request processed in 36946us (37133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.750914:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:0.0:1788483017.758236:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.758437:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087038720 00000100:00100000:1.0:1788483017.758446:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087038720 00000100:00100000:1.0:1788483017.758502:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:1.0:1788483017.758513:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:10493:x1875360087038720:12345-192.168.206.54@tcp:101:touch.500 00010000:00010000:1.0:1788483017.758533:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483017.758554:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a73d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1f8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.758657:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.758671:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.758681:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.758736:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.758757:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.758765:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483017.759214:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788483017.760743:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760759:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760771:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760804:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760811:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760819:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760825:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.760829:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760837:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760867:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483017.760870:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.760875:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760882:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a744 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483017.760896:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000217cc418 reply state 000000008bf9b971 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760907:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760913:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9a69df303800) 00010000:00010000:1.0:1788483017.760915:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788483017.760918:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788483017.760953:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a73d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1f8 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760967:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1f8 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.760974:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303000) 00010000:00010000:1.0:1788483017.760976:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483017.760978:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b200, rc 0) 00000100:00100000:1.0:1788483017.761087:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:10493:x1875360087038720:12345-192.168.206.54@tcp:101:touch.500 Request processed in 2567us (2851us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788483017.761306:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:3.0:1788483017.772646:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483017.773055:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087038976 00000100:00100000:2.0:1788483017.773065:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087038976 00000100:00100000:1.0:1788483017.773336:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:1.0:1788483017.773348:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:10493:x1875360087038976:12345-192.168.206.54@tcp:36:touch.500 00010000:00010000:1.0:1788483017.773406:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483017.773432:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a752 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1f8 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.773450:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303000) 00010000:00010000:1.0:1788483017.773461:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483017.773507:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.773521:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.773530:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483017.773629:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043d7b274 reply state 00000000b8322e4d transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.773641:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.773647:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483017.773650:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788483017.773652:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483017.773739:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:10493:x1875360087038976:12345-192.168.206.54@tcp:36:touch.500 Request processed in 393us (1101us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788483017.773746:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:3.0:1788483017.777800:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483017.777876:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087039104 00000100:00100000:0.0:1788483017.777892:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087039104 00000100:00100000:0.0:1788483017.777962:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:0.0:1788483017.777972:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:10493:x1875360087039104:12345-192.168.206.54@tcp:101:touch.500 00010000:00010000:0.0:1788483017.777994:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483017.778014:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e1ff expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.778068:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ff expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.778143:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ff expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.778165:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303200) 00010000:00010000:0.0:1788483017.778168:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483017.778172:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8000, rc 0) 00000100:00100000:0.0:1788483017.778236:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:10493:x1875360087039104:12345-192.168.206.54@tcp:101:touch.500 Request processed in 265us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483017.778243:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:0.0:1788483017.786230:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.786448:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087039232 00000100:00100000:1.0:1788483017.786473:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087039232 00000100:00100000:1.0:1788483017.786525:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:1.0:1788483017.786534:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875360087039232:12345-192.168.206.54@tcp:8:touch.500 00010000:00080000:1.0:1788483017.786569:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:1.0:1788483017.786620:0:8409:0:(genops.c:1385:class_connect()) connect: client d93ec387-f41f-455a-afdd-b6a72a2f59de, cookie 0x1d7ea3d89ea1a76e 00002000:00100000:1.0:1788483017.786635:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d93ec387-f41f-455a-afdd-b6a72a2f59de/ffff9a69ed824800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788483017.786654:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788483017.786727:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788483017.786757:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9a69efd44800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483017.786819:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2389:x1875360087039232:12345-192.168.206.54@tcp:8:touch.500 Request processed in 285us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.786828:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:2.0:1788483017.789617:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.789724:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087039360 00000100:00100000:1.0:1788483017.789733:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087039360 00000100:00100000:1.0:1788483017.789806:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:1.0:1788483017.789816:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:0:x1875360087039360:12345-192.168.206.54@tcp:2:touch.500 00000100:00080000:0.0:1788483017.790169:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788483017.800175:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788483017.800189:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000100:00100000:0.0:1788483017.802671:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:0:x1875360087039360:12345-192.168.206.54@tcp:2:touch.500 Request processed in 12846us (13053us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788483017.802684:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:3.0:1788483017.807376:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483017.807552:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087039616 00000100:00100000:2.0:1788483017.807563:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087039616 00000100:00100000:2.0:1788483017.807619:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:2.0:1788483017.807629:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:10493:x1875360087039616:12345-192.168.206.54@tcp:35:touch.500 00000100:00100000:2.0:1788483017.807891:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:10493:x1875360087039616:12345-192.168.206.54@tcp:35:touch.500 Request processed in 263us (523us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788483017.807898:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:3.0:1788483017.837045:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.837260:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087039744 00000100:00100000:1.0:1788483017.837282:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087039744 00000100:00100000:1.0:1788483017.837354:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:1.0:1788483017.837363:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:10494:x1875360087039744:12345-192.168.206.54@tcp:101:rm.0 00010000:00010000:1.0:1788483017.837389:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483017.837413:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e206 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.837491:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a77c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.837528:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.837540:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483017.837595:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483017.837599:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483017.837644:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.837675:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e206 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.837696:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a77c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e206 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.837706:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483017.837709:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483017.837714:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b600, rc 0) 00000100:00100000:1.0:1788483017.837770:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:10494:x1875360087039744:12345-192.168.206.54@tcp:101:rm.0 Request processed in 408us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.837777:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:3.0:1788483017.841732:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483017.841818:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087040000 00000100:00100000:0.0:1788483017.841837:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087040000 00000100:00100000:0.0:1788483017.841919:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:0.0:1788483017.841933:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:10494:x1875360087040000:12345-192.168.206.54@tcp:101:rm.0 00010000:00010000:0.0:1788483017.841960:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483017.841983:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e20d expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483017.842404:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788483017.842556:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a783 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e20d expref: 16 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.842571:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56f00) 00010000:00010000:0.0:1788483017.842574:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483017.842579:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e20d expref: 16 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483017.842592:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9400, rc 0) 00000100:00100000:0.0:1788483017.842674:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:10494:x1875360087040000:12345-192.168.206.54@tcp:101:rm.0 Request processed in 742us (972us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788483017.842681:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 34 00010000:00010000:2.0:1788483017.848489:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483017.850270:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483017.850391:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087040128 00000100:00100000:2.0:1788483017.850404:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087040128 00000100:00100000:2.0:1788483017.850473:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:2.0:1788483017.850484:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:10494:x1875360087040128:12345-192.168.206.54@tcp:37:rm.0 00000100:00100000:2.0:1788483017.857238:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:10494:x1875360087040128:12345-192.168.206.54@tcp:37:rm.0 Request processed in 6740us (6982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483017.857261:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:3.0:1788483017.867006:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.867122:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087040384 00000100:00100000:1.0:1788483017.867131:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087040384 00000100:00100000:1.0:1788483017.867182:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:1.0:1788483017.867192:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4625850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:10494:x1875360087040384:12345-192.168.206.54@tcp:35:rm.0 00000100:00100000:1.0:1788483017.867409:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4625850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:10494:x1875360087040384:12345-192.168.206.54@tcp:35:rm.0 Request processed in 218us (411us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788483017.867422:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:3.0:1788483017.872872:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.874420:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087040640 00000100:00100000:1.0:1788483017.874439:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087040640 00000100:00100000:1.0:1788483017.874521:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:1.0:1788483017.874531:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:10494:x1875360087040640:12345-192.168.206.54@tcp:101:rm.0 00010000:00010000:1.0:1788483017.874558:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483017.874580:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e214 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.874678:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a798 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.874693:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a798 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.874704:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a798 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483017.874714:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788483017.874810:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e214 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.874828:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a798 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e214 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.874837:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483017.874840:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788483017.874843:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b000, rc 0) 00000100:00100000:1.0:1788483017.874918:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:10494:x1875360087040640:12345-192.168.206.54@tcp:101:rm.0 Request processed in 389us (2061us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788483017.874925:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:0.0:1788483017.885826:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.885902:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087040768 00000100:00100000:1.0:1788483017.885917:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087040768 00000100:00100000:1.0:1788483017.885992:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:1.0:1788483017.886003:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:10494:x1875360087040768:12345-192.168.206.54@tcp:41:rm.0 00000004:00000024:1.0:1788483017.886059:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788483017.886202:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:10494:x1875360087040768:12345-192.168.206.54@tcp:41:rm.0 Request processed in 198us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.886209:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:0.0:1788483017.893553:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.896657:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087040896 00000100:00100000:1.0:1788483017.896672:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087040896 00000100:00100000:1.0:1788483017.896794:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:1.0:1788483017.896806:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:10494:x1875360087040896:12345-192.168.206.54@tcp:101:rm.0 00010000:00010000:1.0:1788483017.896828:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483017.896848:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a7a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e21b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.896917:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.896931:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.896942:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.896976:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.896990:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.896998:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.897131:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1a7bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.897141:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1a7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.897148:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1a7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483017.897182:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788483017.897186:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483017.897213:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1a7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.897226:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1a7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.897234:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.897240:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.897247:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899653:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.899659:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899669:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899687:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483017.899689:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.899694:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899701:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1a7ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899719:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899725:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899732:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899737:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.899739:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899745:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899774:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9a69df303800) 00010000:00010000:1.0:1788483017.899777:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.899780:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899786:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899828:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1a7a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e21b expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899843:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1a7bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e21b expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.899850:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483017.899853:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483017.899855:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27c00, rc 0) 00000100:00100000:1.0:1788483017.899921:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:10494:x1875360087040896:12345-192.168.206.54@tcp:101:rm.0 Request processed in 3117us (6376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.899929:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:3.0:1788483017.904946:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.905495:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087041152 00000100:00100000:1.0:1788483017.905505:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087041152 00000100:00100000:1.0:1788483017.906297:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:1.0:1788483017.906311:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:10494:x1875360087041152:12345-192.168.206.54@tcp:36:rm.0 00010000:00010000:1.0:1788483017.906368:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788483017.906395:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1a7bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e21b expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906434:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ff expref: 18 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906444:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483017.906453:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b600/0x1d7ea3d89ea1a77c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e206 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906461:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483017.906464:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483017.906485:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906498:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906507:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906518:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906525:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906531:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906644:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906663:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.906670:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483017.907184:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788483017.907194:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310170097573ns, next at 311170095271ns, rc = 0 00010000:00010000:1.0:1788483017.907241:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907250:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907257:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907264:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907270:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907276:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907306:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483017.907323:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907338:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907355:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907360:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.907364:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907371:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907380:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483017.907382:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788483017.907385:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907391:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1a7d0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907406:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907412:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907418:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907423:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483017.907425:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907440:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907448:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483017.907450:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483017.907453:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907458:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1a7c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483017.907466:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0ae16a6 reply state 0000000090d10255 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907476:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483017.907481:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9a69df303800) 00010000:00010000:1.0:1788483017.907483:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788483017.907486:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483017.907562:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:10494:x1875360087041152:12345-192.168.206.54@tcp:36:rm.0 Request processed in 1254us (2621us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788483017.907570:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 38 00010000:00010000:3.0:1788483017.907737:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483017.907745:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.907754:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483017.907757:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.907764:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.907774:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303200) 00010000:00010000:3.0:1788483017.907777:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788483017.907780:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.907785:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1a7d7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483017.907798:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483017.907799:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483017.907801:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483017.917226:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483017.917423:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087041408 00000100:00100000:1.0:1788483017.917433:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087041408 00000100:00100000:1.0:1788483017.917480:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:1.0:1788483017.917490:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:10494:x1875360087041408:12345-192.168.206.54@tcp:35:rm.0 00000100:00100000:1.0:1788483017.917706:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:10494:x1875360087041408:12345-192.168.206.54@tcp:35:rm.0 Request processed in 216us (488us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788483017.917729:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:1.0:1788483017.920604:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483017.920671:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087041664 00000100:00100000:2.0:1788483017.920682:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087041664 00000100:00100000:2.0:1788483017.920739:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:2.0:1788483017.920749:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:10494:x1875360087041664:12345-192.168.206.54@tcp:36:rm.0 00010000:00010000:2.0:1788483017.920797:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788483017.920823:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1a798 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e214 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920845:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1a736 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1f1 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920857:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69df303700) 00010000:00010000:2.0:1788483017.920871:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a6f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1e3 expref: 17 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920880:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56f00) 00010000:00010000:2.0:1788483017.920886:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483017.920910:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920921:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920931:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920958:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920966:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.920972:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.921040:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.921049:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.921055:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483017.924138:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788483017.924160:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924170:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924178:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924183:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483017.924188:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924210:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924226:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a69c591a600) 00010000:00010000:2.0:1788483017.924228:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788483017.924233:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924240:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a7ec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924739:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924747:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924752:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924757:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483017.924759:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924764:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924773:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69c591a700) 00010000:00010000:2.0:1788483017.924775:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483017.924778:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924795:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a7de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483017.924808:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000577c9fe0 reply state 000000000e2e29f2 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924820:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483017.924826:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69c591af00) 00010000:00010000:2.0:1788483017.924828:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483017.924832:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483017.924918:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:10494:x1875360087041664:12345-192.168.206.54@tcp:36:rm.0 Request processed in 4166us (4317us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788483017.924927:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:0.0:1788483017.976516:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098659712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483017.976599:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483017.976696:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659712 00000100:00100000:1.0:1788483017.976705:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659712 00000100:00100000:1.0:1788483017.976770:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788483017.976780:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098659712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483017.976812:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1788483017.976868:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098659712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483017.976875:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788483017.976949:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098659712:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788483018.886374:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788483019.002684:0:9965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311265585315ns, next at 312265582538ns, rc = 0 00000100:00100000:2.0:1788483019.002720:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098659840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483019.002783:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003082:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098660096:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003136:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003158:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098660608:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003178:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003217:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098661120:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003248:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003268:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788483019.003273:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098660224:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003297:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003314:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098660736:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003333:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003347:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098661248:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003365:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003383:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098659968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003410:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003431:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098660480:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003451:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003468:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098660992:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003491:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003510:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788483019.003515:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098660352:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003535:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003545:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098660864:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003561:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003577:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098661376:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003595:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483019.003621:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659968 00000100:00100000:3.0:1788483019.003628:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659968 00000100:00100000:3.0:1788483019.003668:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788483019.003677:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098659968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003729:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098659968:12345-0@lo:400:kworker.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.003736:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788483019.003766:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660224 00000100:00100000:3.0:1788483019.003770:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660224 00000100:00100000:3.0:1788483019.003791:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660480 00000100:00100000:3.0:1788483019.003794:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660480 00000100:00100000:3.0:1788483019.003808:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788483019.003814:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098660224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003849:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098660224:12345-0@lo:400:kworker.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.003855:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788483019.003866:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788483019.003871:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098660480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.003894:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098660480:12345-0@lo:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.003899:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788483019.003915:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660992 00000100:00100000:3.0:1788483019.003918:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660992 00000100:00100000:3.0:1788483019.003950:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660864 00000100:00100000:3.0:1788483019.003953:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660864 00000100:00100000:3.0:1788483019.003966:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098661376 00000100:00100000:3.0:1788483019.003968:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098661376 00000100:00100000:3.0:1788483019.003981:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788483019.003988:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098660992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.004018:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098660992:12345-0@lo:400:kworker.0 Request processed in 31us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.004034:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788483019.004233:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788483019.004239:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098660864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.004267:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098660864:12345-0@lo:400:kworker.0 Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.004273:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788483019.004284:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788483019.004290:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098661376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.004316:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098661376:12345-0@lo:400:kworker.0 Request processed in 26us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.004322:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788483019.004343:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483019.004346:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788483019.004378:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e78a80 x1875360098660864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483019.004392:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098660864:0@lo:400:kworker.0 00010000:00080000:3.0:1788483019.004404:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e79500 x1875360098661376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483019.004412:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098661376:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.004422:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098659968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.004431:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098660480:0@lo:400:kworker.0 00010000:00080000:3.0:1788483019.004441:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e78000 x1875360098660992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483019.004462:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098660992:0@lo:400:kworker.0 00000100:00100000:3.0:1788483019.004497:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098660224:0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.004779:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660096 00000100:00100000:2.0:1788483019.004786:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660096 00000100:00100000:2.0:1788483019.004813:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660608 00000100:00100000:2.0:1788483019.004815:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660608 00000100:00100000:2.0:1788483019.004829:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098661120 00000100:00100000:2.0:1788483019.004831:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098661120 00000100:00100000:2.0:1788483019.004841:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660736 00000100:00100000:2.0:1788483019.004843:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660736 00000100:00100000:2.0:1788483019.004852:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098661248 00000100:00100000:2.0:1788483019.004855:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098661248 00000100:00100000:2.0:1788483019.004877:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098660352 00000100:00100000:2.0:1788483019.004879:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098660352 00000100:00100000:2.0:1788483019.004892:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788483019.004898:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098660096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.004947:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098660096:12345-0@lo:400:kworker.0 Request processed in 49us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.004953:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788483019.004965:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788483019.004971:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098660608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.004997:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098660608:12345-0@lo:400:kworker.0 Request processed in 27us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.005003:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788483019.005014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788483019.005020:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098661120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005061:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098661120:12345-0@lo:400:kworker.0 Request processed in 41us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.005067:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788483019.005089:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788483019.005113:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098660736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005143:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098660736:12345-0@lo:400:kworker.0 Request processed in 48us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.005149:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788483019.005160:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788483019.005166:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098661248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005189:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098661248:12345-0@lo:400:kworker.0 Request processed in 24us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.005213:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788483019.005226:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788483019.005232:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098660352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005266:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098660352:12345-0@lo:400:kworker.0 Request processed in 34us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.005271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00080000:2.0:1788483019.005310:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e7ad80 x1875360098660736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483019.005321:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098660736:0@lo:400:kworker.0 00010000:00080000:2.0:1788483019.005331:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e7b480 x1875360098661248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483019.005339:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098661248:0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005349:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098660096:0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005359:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098660608:0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005368:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098661120:0@lo:400:kworker.0 00000100:00100000:2.0:1788483019.005396:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098660352:0@lo:400:kworker.0 00000100:00080000:3.0:1788483019.005551:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483019.005555:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483019.006207:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098659840 00000100:00100000:2.0:1788483019.006215:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098659840 00000100:00100000:2.0:1788483019.006267:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788483019.006275:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098659840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788483019.006292:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483019.006337:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098659840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.006352:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788483019.009308:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788483019.009364:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f15f80 x1875360098659840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483019.009389:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098659840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483019.512534:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098661504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483019.512603:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483019.512754:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098661504 00000100:00100000:2.0:1788483019.512763:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098661504 00000100:00100000:2.0:1788483019.512818:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788483019.512829:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098661504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788483019.512851:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483019.512911:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098661504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.512919:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788483019.513023:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f15f80 x1875360098661504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483019.513040:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098661504:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788483019.896342:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483020.536433:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098661632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483020.536499:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483020.536577:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098661632 00000100:00100000:2.0:1788483020.536585:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098661632 00000100:00100000:2.0:1788483020.536629:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788483020.536639:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098661632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483020.536667:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483020.536999:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098661632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.537009:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1788483020.537053:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae3800 x1875360098661632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483020.537082:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098661632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483020.537210:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098661760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483020.537243:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483020.537878:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098661760 00000100:00100000:0.0:1788483020.537885:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098661760 00000100:00100000:0.0:1788483020.537929:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788483020.537937:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098661760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483020.537952:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483020.538005:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098661760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483020.538012:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788483020.538031:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483020.538040:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098661888:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788483020.538462:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edae0700 x1875360098661760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483020.538480:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098661760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483020.538543:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483020.542460:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098661888 00000100:00100000:1.0:1788483020.542474:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098661888 00000100:00100000:1.0:1788483020.542543:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788483020.542556:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098661888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483020.542852:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483020.542957:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098661888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 404us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483020.542964:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788483020.543560:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098661888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788483020.921750:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483021.944687:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483021.965568:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483021.965616:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483021.965641:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483021.965660:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483021.965681:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483021.965734:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483021.965768:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042048 00000100:00100000:0.0:1788483021.965780:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042048 00000100:00100000:0.0:1788483021.965860:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042304 00000100:00100000:0.0:1788483021.965863:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042304 00000100:00100000:0.0:1788483021.965882:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087041920 00000100:00100000:0.0:1788483021.965884:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087041920 00000100:00100000:0.0:1788483021.965900:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042432 00000100:00100000:0.0:1788483021.965902:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042432 00000100:00100000:3.0:1788483021.965904:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042176 00000100:00100000:3.0:1788483021.965911:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042176 00000100:00100000:0.0:1788483021.965923:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 219 00000100:00100000:0.0:1788483021.965937:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087042048:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483021.965955:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 93 00000100:00100000:3.0:1788483021.965966:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087042176:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483021.966036:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087042048:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 102us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.966043:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 219 00000100:00100000:0.0:1788483021.966069:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 220 00000100:00100000:0.0:1788483021.966075:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087042304:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483021.966220:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087041792 00000100:00100000:1.0:1788483021.966225:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087041792 00000100:00100000:1.0:1788483021.966258:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 339 00000100:00100000:1.0:1788483021.966265:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087041792:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483021.970657:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087042176:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 4663us (4944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483021.970678:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 93 00000100:00080000:3.0:1788483021.970750:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483021.970757:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483021.970761:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788483021.971740:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087042304:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 5650us (6084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.971760:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 220 00000100:00100000:0.0:1788483021.971804:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 221 00000100:00100000:0.0:1788483021.971838:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:2393:x1875360087041920:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483021.971924:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:2393:x1875360087041920:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 111us (6262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.971931:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 221 00000100:00100000:0.0:1788483021.971944:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 222 00000100:00100000:0.0:1788483021.971952:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087042432:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483021.972363:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087042432:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 411us (6627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.972371:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 222 00000100:00100000:1.0:1788483021.973013:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087041792:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 6733us (7445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483021.973026:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 339 00000001:02000400:2.0:1788483022.064631:0:13658:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788483022.968446:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483023.097134:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098662016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483023.098696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483023.098750:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098662016 00000100:00100000:0.0:1788483023.098768:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098662016 00000100:00100000:0.0:1788483023.098870:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788483023.098883:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098662016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483023.098928:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788483023.099479:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098662016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483023.099530:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098662016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 465us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.099541:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000020:00000080:2.0:1788483023.291928:0:13706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd0350e60 20000000:00000080:2.0:1788483023.291946:0:13706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a68c3d79800 uarg=0000000000000000 20000000:01000000:2.0:1788483023.291991:0:13706:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788483023.291998:0:13706:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788483023.292003:0:13706:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788483023.297364:0:13707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788483023.297714:0:13706:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788483023.303725:0:13706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788483023.303777:0:13706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788483023.303793:0:13706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788483023.303807:0:13706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788483023.303827:0:13706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303863:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303870:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303877:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303883:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303892:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303899:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303907:0:13706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303946:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.303962:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 12 pid: 6488 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483023.303977:0:13706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662144:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483023.307507:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.307525:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.307540:0:13706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662272:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483023.307776:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.307786:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 23 pid: 6488 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.307795:0:13706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662400:0@lo:104: 00000100:00100000:1.0:1788483023.307849:0:13706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788483023.307893:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.307901:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 23 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.307923:0:13706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662528:0@lo:104: 00010000:00010000:1.0:1788483023.307951:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.307959:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 23 pid: 6486 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.307967:0:13706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662656:0@lo:104: 00010000:00010000:1.0:1788483023.307989:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.307996:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 23 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.308004:0:13706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662784:0@lo:104: 00000100:00100000:1.0:1788483023.308021:0:13706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483023.308352:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788483023.308375:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483023.308403:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483023.308421:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483023.308431:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098662400 00000100:00100000:1.0:1788483023.308437:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098662400 00000100:00100000:1.0:1788483023.308477:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098662528 00000100:00100000:3.0:1788483023.308479:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098662656 00000100:00100000:1.0:1788483023.308481:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098662528 00000100:00100000:3.0:1788483023.308493:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098662656 00000100:00100000:1.0:1788483023.308494:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098662784 00000100:00100000:1.0:1788483023.308499:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098662784 00000100:00100000:3.0:1788483023.308530:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483023.308540:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5905850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:13706:x1875360098662400:12345-0@lo:104: 00000100:00100000:1.0:1788483023.308542:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1788483023.308555:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.308606:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483023.309008:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5905850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+6:13706:x1875360098662400:12345-0@lo:104: Request processed in 75us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483023.309023:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483023.309091:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483023.309122:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:13706:x1875360098662656:12345-0@lo:104: 00010000:00010000:3.0:1788483023.309131:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309171:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788483023.309177:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+5:13706:x1875360098662656:12345-0@lo:104: Request processed in 57us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483023.309183:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483023.309197:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788483023.309203:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:13706:x1875360098662784:12345-0@lo:104: 00010000:00010000:3.0:1788483023.309210:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309242:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788483023.309247:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+4:13706:x1875360098662784:12345-0@lo:104: Request processed in 44us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483023.309252:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788483023.309277:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788483023.309283:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309290:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483023.309294:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309301:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483023.309308:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483023.309313:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483023.309344:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309351:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483023.309371:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309377:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1a6aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a6b1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309389:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483023.309392:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309398:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8aa00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483023.309400:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309414:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483023.309421:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483023.309426:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483023.309441:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309446:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483023.309452:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309459:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8aa00/0x1d7ea3d89ea1a68e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a695 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309591:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483023.309595:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309600:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483023.309603:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309610:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483023.309616:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483023.309628:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483023.309645:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309651:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483023.309669:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309675:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1a680 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a687 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.309684:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483023.309685:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483023.309687:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483023.309693:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483023.309698:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483023.311929:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:13706:x1875360098662528:12345-0@lo:104: 00010000:00010000:1.0:1788483023.311968:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.312086:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788483023.312093:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+3:13706:x1875360098662528:12345-0@lo:104: Request processed in 3540us (3719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.312121:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788483023.312799:0:13706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662400:0@lo:104: 00000100:00100000:1.0:1788483023.312809:0:13706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662528:0@lo:104: 00000100:00100000:1.0:1788483023.312817:0:13706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662656:0@lo:104: 00000100:00100000:1.0:1788483023.312825:0:13706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662784:0@lo:104: 00000100:00100000:1.0:1788483023.312890:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098663168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483023.312935:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483023.312981:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098663040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483023.313001:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483023.313018:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483023.313023:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098662912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483023.313037:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483023.313997:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663168 00000100:00100000:1.0:1788483023.314007:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663168 00010000:00010000:1.0:1788483023.314064:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 24 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.314110:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663040 00000100:00100000:1.0:1788483023.314114:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663040 00010000:00010000:1.0:1788483023.314127:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 25 pid: 6486 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.314168:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098662912 00000100:00100000:1.0:1788483023.314171:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098662912 00010000:00010000:1.0:1788483023.314184:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 26 pid: 6488 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.314195:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483023.314202:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+26:3619:x1875360098663168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483023.314214:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483023.314220:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 26 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314229:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 26 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314246:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a680 expref: 26 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314259:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483023.314304:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+25:3619:x1875360098663168:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.314311:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483023.314328:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483023.314334:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098663040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483023.314341:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483023.314346:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 24 pid: 6486 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314353:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 24 pid: 6486 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314368:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a695 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a68e expref: 24 pid: 6486 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314377:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483023.314405:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:3622:x1875360098663040:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.314411:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483023.314423:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788483023.314429:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:3622:x1875360098662912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483023.314435:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483023.314439:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 22 pid: 6488 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314447:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 22 pid: 6488 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314457:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1a6b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a6aa expref: 22 pid: 6488 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314465:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483023.314486:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3622:x1875360098662912:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.314492:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788483023.314525:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098662912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483023.314533:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098663040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483023.314559:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098663168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483023.314580:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483023.314586:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314593:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8bc00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483023.314596:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314604:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483023.314612:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483023.314618:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788483023.314642:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314649:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483023.314678:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314684:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1a69c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1a6a3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314696:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483023.314698:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483023.314699:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483023.314708:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098663296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483023.314736:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483023.314770:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663296 00000100:00100000:1.0:1788483023.314775:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663296 00010000:00010000:1.0:1788483023.314789:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 21 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.314802:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788483023.314807:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3620:x1875360098663296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483023.314818:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483023.314821:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 21 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314828:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 21 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314837:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1a6a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1a69c expref: 21 pid: 6487 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.314845:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483023.314871:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3620:x1875360098663296:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.314877:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788483023.314898:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098663296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483023.317324:0:13706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662144:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483023.317337:0:13706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875360098662272:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483023.317370:0:13706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483023.322549:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483023.322786:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042560 00000100:00100000:1.0:1788483023.322797:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042560 00010000:00010000:1.0:1788483023.322854:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 13 pid: 6488 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.322901:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:1.0:1788483023.322910:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c71c064-eed6-492d-871f-d947c33908cf+13:2392:x1875360087042560:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483023.322924:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483023.322930:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 13 pid: 6488 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.322941:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 13 pid: 6488 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.322962:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1a6bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1d5 expref: 13 pid: 6488 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.322976:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483023.323033:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c71c064-eed6-492d-871f-d947c33908cf+12:2392:x1875360087042560:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 123us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.323040:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 50 00000004:00080000:1.0:1788483023.323829:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788483023.323869:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788483023.323877:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788483023.323929:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.323938:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.323945:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.323951:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ba00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483023.323956:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.323963:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.323976:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9a69df303800) 00010000:00010000:0.0:1788483023.323979:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483023.323983:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324001:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1a74b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324019:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324026:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324032:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324036:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ac00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483023.324039:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324045:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324065:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a69df303200) 00010000:00010000:0.0:1788483023.324068:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483023.324071:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324077:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1a760 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324118:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483023.324119:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788483023.324129:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324219:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324224:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483023.324227:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324234:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324242:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9a69df303800) 00010000:00010000:0.0:1788483023.324244:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483023.324247:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324256:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1a7c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324271:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324277:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324282:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324286:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483023.324288:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324306:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324316:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69c591af00) 00010000:00010000:0.0:1788483023.324318:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483023.324321:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.324327:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a7e5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483023.325937:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483023.326070:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042688 00000100:00100000:1.0:1788483023.326079:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042688 00010000:00010000:1.0:1788483023.326135:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.326184:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:1.0:1788483023.326193:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+12:2393:x1875360087042688:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483023.326215:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483023.326221:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326232:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326250:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a6b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e1ce expref: 12 pid: 6486 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326264:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326272:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326286:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326293:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326300:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326308:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326314:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483023.326318:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326335:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326351:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.326361:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483023.326407:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+11:2393:x1875360087042688:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 215us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.326415:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:2.0:1788483023.326435:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098663424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788483023.326487:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483023.326576:0:13706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.326585:0:13706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483023.326592:0:13706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77800/0x1d7ea3d89ea1a7f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483023.327600:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663424 00000100:00100000:1.0:1788483023.327610:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663424 00000100:00080000:3.0:1788483023.327653:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483023.327728:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788483023.327738:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098663424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788483023.327765:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788483023.327799:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9a15c9, atime: 0x6a9a15c9, ctime: 0x6a9a15c9, blocks: 0x0 00010000:00010000:1.0:1788483023.327807:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.327821:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1788483023.327826:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483023.327832:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.327849:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.327870:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.327877:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483023.327901:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483023.327930:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483023.327939:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.327949:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483023.327953:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.327962:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.327992:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.327999:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1a7fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483023.328031:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483023.328034:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483023.328036:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483023.328084:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098663424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 347us (1596us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788483023.328091:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788483023.328236:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a68c3e78a80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788483023.328242:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098663424:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788483023.992384:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483024.121385:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098663552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483024.121448:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483024.121621:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663552 00000100:00100000:3.0:1788483024.121629:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663552 00000100:00100000:3.0:1788483024.121667:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788483024.121675:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098663552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483024.121700:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483024.121741:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098663552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.121748:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788483024.121785:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098663552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483024.122535:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098664064:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.122577:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483024.122600:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098664576:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.122624:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483024.122648:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098665088:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.122669:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483024.122689:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788483024.122710:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098663936:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.122736:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483024.122768:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098664448:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.122790:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483024.122805:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098664960:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.122844:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483024.122877:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664064 00000100:00100000:0.0:1788483024.122882:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664064 00000100:00100000:0.0:1788483024.122913:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664448 00000100:00100000:0.0:1788483024.122916:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664448 00000100:00100000:0.0:1788483024.122936:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664960 00000100:00100000:0.0:1788483024.122939:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664960 00000100:00100000:0.0:1788483024.122955:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788483024.122961:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098664064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.122967:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098663680:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.122998:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483024.123002:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098664064:12345-0@lo:400:kworker.0 Request processed in 41us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.123009:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788483024.123020:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098664192:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.123041:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483024.123069:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098664704:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.123092:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483024.123137:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788483024.123143:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098663808:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.123165:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483024.123176:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098664320:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.123195:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483024.123205:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098664832:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123246:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663808 00000100:00100000:0.0:1788483024.123250:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663808 00000100:00100000:0.0:1788483024.123263:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664320 00000100:00100000:0.0:1788483024.123265:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664320 00000100:00100000:0.0:1788483024.123279:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788483024.123285:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098664448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123318:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098664448:12345-0@lo:400:kworker.0 Request processed in 33us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.123324:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788483024.123335:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788483024.123341:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098664960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123381:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098664960:12345-0@lo:400:kworker.0 Request processed in 40us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.123386:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788483024.123398:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788483024.123404:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098663808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123430:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098663808:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.123435:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788483024.123445:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788483024.123450:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098664320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123476:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098664320:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.123481:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788483024.123500:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664576 00000100:00100000:3.0:1788483024.123557:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483024.123592:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098663808:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.123602:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098664320:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123625:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664576 00000100:00100000:3.0:1788483024.123629:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663936 00000100:00100000:3.0:1788483024.123632:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663936 00000100:00100000:3.0:1788483024.123654:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664192 00000100:00100000:0.0:1788483024.123654:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665088 00000100:00100000:3.0:1788483024.123656:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664192 00000100:00100000:0.0:1788483024.123657:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665088 00000100:00100000:0.0:1788483024.123666:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664704 00000100:00100000:3.0:1788483024.123668:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788483024.123669:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664704 00000100:00100000:3.0:1788483024.123674:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098663936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123679:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788483024.123685:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098664576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.123705:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098663936:12345-0@lo:400:kworker.0 Request processed in 31us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.123709:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098664576:12345-0@lo:400:kworker.0 Request processed in 26us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.123711:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788483024.123715:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788483024.123722:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788483024.123723:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788483024.123728:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098664192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123728:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098665088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.123767:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098664192:12345-0@lo:400:kworker.0 Request processed in 39us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.123774:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788483024.123775:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098665088:12345-0@lo:400:kworker.0 Request processed in 47us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.123781:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788483024.123790:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788483024.123796:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098664704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.123977:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098664704:12345-0@lo:400:kworker.0 Request processed in 180us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.124647:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098664192:0@lo:400:kworker.0 00010000:00080000:3.0:1788483024.124661:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3da6680 x1875360098664704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483024.124672:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098664704:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.124692:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098664832 00000100:00100000:3.0:1788483024.124696:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098664832 00000100:00100000:3.0:1788483024.124720:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788483024.124726:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098664832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.124766:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098664832:12345-0@lo:400:kworker.0 Request processed in 39us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.124771:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788483024.124797:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098664832:0@lo:400:kworker.0 00000100:00080000:3.0:1788483024.125058:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483024.125063:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483024.125066:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483024.125068:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483024.125129:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098663680 00000100:00100000:3.0:1788483024.125134:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098663680 00000100:00100000:3.0:1788483024.125162:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788483024.125168:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3619:x1875360098663680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.125205:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3619:x1875360098663680:12345-0@lo:400:kworker.0 Request processed in 37us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.125231:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788483024.125269:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098663680:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.125294:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098663936:0@lo:400:kworker.0 00010000:00080000:3.0:1788483024.125307:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3da6a00 x1875360098664448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483024.125317:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098664448:0@lo:400:kworker.0 00010000:00080000:3.0:1788483024.125327:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3da4e00 x1875360098664960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483024.125335:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098664960:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.125346:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098664064:0@lo:400:kworker.0 00010000:00080000:3.0:1788483024.125356:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3da7b80 x1875360098664576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483024.125363:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098664576:0@lo:400:kworker.0 00000100:00100000:3.0:1788483024.125376:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098665088:0@lo:400:kworker.0 00000100:00100000:0.0:1788483024.128860:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000020:00000080:0.0:1788483024.312652:0:13755:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6ebc0150 20000000:00000080:0.0:1788483024.312669:0:13755:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a69d0f27400 uarg=0000000000000000 20000000:01000000:0.0:1788483024.312785:0:13755:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788483024.312792:0:13755:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788483024.312797:0:13755:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788483024.315088:0:13756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788483024.315324:0:13755:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788483024.315424:0:13755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788483024.315456:0:13755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788483024.315473:0:13755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788483024.315486:0:13755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788483024.315508:0:13755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315524:0:13755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315534:0:13755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315542:0:13755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315564:0:13755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315571:0:13755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315578:0:13755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483024.315582:0:13755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315589:0:13755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315603:0:13755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315612:0:13755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483024.315619:0:13755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8200/0x1d7ea3d89ea1a801 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483024.632728:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098665216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483024.632800:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483024.633139:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665216 00000100:00100000:2.0:1788483024.633148:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665216 00000100:00100000:2.0:1788483024.633210:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788483024.633301:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098665216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788483024.633323:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483024.633511:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098665216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 213us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483024.633518:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788483024.635365:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098665216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483024.654883:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483024.655522:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042816 00000100:00100000:1.0:1788483024.655532:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042816 00000100:00100000:1.0:1788483024.655599:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 341 00000100:00100000:1.0:1788483024.655610:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+11:6166:x1875360087042816:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483024.655628:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483024.655648:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1a808 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e222 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483024.655676:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1a808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e222 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483024.655686:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1a808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e222 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483024.655695:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26e00, rc 0) 00000100:00100000:1.0:1788483024.655769:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087042816:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 160us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483024.655791:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 341 00000100:00100000:3.0:1788483024.659323:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483024.659780:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087042944 00000100:00100000:0.0:1788483024.659796:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087042944 00000100:00100000:0.0:1788483024.659866:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 342 00000100:00100000:0.0:1788483024.659878:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087042944:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483024.660328:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087042944:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 450us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.660353:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 342 00000100:00100000:0.0:1788483024.664786:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483024.664881:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043072 00000100:00100000:3.0:1788483024.664895:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043072 00000100:00100000:3.0:1788483024.664958:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 343 00000100:00100000:3.0:1788483024.664986:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087043072:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483024.666425:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087043072:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 1421us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483024.666441:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 343 00000100:00100000:3.0:1788483024.670538:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483024.670724:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043200 00000100:00100000:0.0:1788483024.670738:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043200 00000100:00100000:0.0:1788483024.670819:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 344 00000100:00100000:0.0:1788483024.670833:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:10778:x1875360087043200:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483024.673877:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:10778:x1875360087043200:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 3028us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.673898:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 344 00000100:00100000:3.0:1788483024.680457:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483024.682213:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043328 00000100:00100000:2.0:1788483024.682234:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043328 00000100:00100000:2.0:1788483024.682378:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 345 00000100:00100000:2.0:1788483024.682390:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+12:10778:x1875360087043328:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788483024.682624:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+12:10778:x1875360087043328:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 236us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483024.682634:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 345 00000100:00100000:0.0:1788483024.710816:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483024.713223:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043456 00000100:00100000:3.0:1788483024.713243:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043456 00000100:00100000:3.0:1788483024.713320:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 346 00000100:00100000:3.0:1788483024.713332:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+12:6166:x1875360087043456:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483024.713353:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483024.713377:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a80f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e229 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483024.713413:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e229 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483024.713426:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e229 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483024.713437:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76200, rc 0) 00000100:00100000:3.0:1788483024.713518:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087043456:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 187us (2715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.713525:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 346 00000100:00100000:3.0:1788483024.716435:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483024.716566:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043584 00000100:00100000:2.0:1788483024.716577:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043584 00000100:00100000:2.0:1788483024.716635:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 347 00000100:00100000:2.0:1788483024.716645:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087043584:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483024.716980:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087043584:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 335us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483024.716989:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 347 00000100:00100000:3.0:1788483024.719156:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483024.719265:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043712 00000100:00100000:0.0:1788483024.719278:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043712 00000100:00100000:0.0:1788483024.719341:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 348 00000100:00100000:0.0:1788483024.719352:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087043712:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483024.719518:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:6166:x1875360087043712:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.719526:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 348 00000100:00100000:0.0:1788483024.733506:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483024.739440:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043840 00000100:00100000:2.0:1788483024.739466:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043840 00000100:00100000:3.0:1788483024.739758:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 349 00000100:00100000:3.0:1788483024.739773:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:10781:x1875360087043840:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788483024.739996:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:10781:x1875360087043840:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 225us (6503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483024.740022:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 349 00000100:00100000:3.0:1788483024.750776:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483024.751079:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087043968 00000100:00100000:0.0:1788483024.751093:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087043968 00000100:00100000:0.0:1788483024.751193:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 350 00000100:00100000:0.0:1788483024.751205:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:10781:x1875360087043968:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483024.751397:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:10781:x1875360087043968:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 194us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483024.751416:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 350 00010000:00010000:1.0:1788483025.016457:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788483025.336240:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788483025.336250:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c1c41000 from 7 10000000:01000000:3.0:1788483025.336257:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483025.337179:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.337197:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.337211:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483025.337242:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.337415:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.337565:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483025.339913:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665344 00000100:00100000:2.0:1788483025.339935:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665344 00000100:00100000:2.0:1788483025.340187:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788483025.340201:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:6491:x1875360098665344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483025.340222:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483025.340246:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1600/0x1d7ea3d89ea1a81d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a816 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483025.340295:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1600/0x1d7ea3d89ea1a81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a816 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483025.340309:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1600/0x1d7ea3d89ea1a81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a816 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483025.340321:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1600, rc 0) 00000100:00100000:2.0:1788483025.340447:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098665344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483025.340455:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788483025.340563:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483025.340588:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.340598:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483025.340691:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.340730:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.348357:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483025.351916:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665472 00000100:00100000:0.0:1788483025.351938:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665472 00000100:00100000:0.0:1788483025.352261:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788483025.352341:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098665472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483025.352592:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098665472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (11861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483025.352601:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788483025.352864:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.352948:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.353382:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.353423:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483025.354409:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665600 00000100:00100000:0.0:1788483025.354425:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665600 00000100:00100000:0.0:1788483025.354490:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788483025.354501:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098665600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483025.354686:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098665600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483025.354695:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788483025.355146:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.356428:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13768:1875360098665728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483025.356523:0:13768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.356574:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483025.356641:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665728 00000100:00100000:0.0:1788483025.356650:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665728 00000100:00100000:0.0:1788483025.356745:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788483025.356758:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:13768:x1875360098665728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483025.356928:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:13768:x1875360098665728:12345-0@lo:502:llog_process_th.0 Request processed in 173us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483025.356936:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788483025.357032:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13768:1875360098665728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483025.357072:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483025.357083:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.357086:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483025.357122:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c1c41000 00000020:00000080:3.0:1788483025.357126:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483025.357194:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483025.363678:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483025.363686:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788483025.363699:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483025.363706:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483025.363708:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788483025.365480:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c1c41000 00000020:00000080:2.0:1788483025.365485:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788483025.365616:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13768:1875360098665856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483025.366474:0:13768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483025.366541:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483025.366624:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665856 00000100:00100000:0.0:1788483025.366635:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665856 00000100:00100000:0.0:1788483025.366706:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788483025.366726:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:13768:x1875360098665856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483025.366905:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:13768:x1875360098665856:12345-0@lo:502:llog_process_th.0 Request processed in 182us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483025.366914:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788483025.368467:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13768:1875360098665856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788483025.368529:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483025.368555:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483025.368559:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788483025.368565:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788483025.369947:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788483025.369990:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483025.370005:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483025.370029:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483025.370052:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788483025.370055:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69e00f6800 from 7 10000000:01000000:0.0:1788483025.370058:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788483025.370132:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483025.370141:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483025.370151:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483025.370180:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483025.370264:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483025.370496:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c35f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483025.370583:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098665984 00000100:00100000:3.0:1788483025.370594:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098665984 00000100:00100000:3.0:1788483025.370650:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788483025.370662:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:6491:x1875360098665984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483025.370678:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483025.370693:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1a82b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a824 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.370739:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1a82b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a824 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.370751:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1a82b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a824 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.370783:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77a00, rc 0) 00000100:00100000:3.0:1788483025.370846:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098665984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483025.370853:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788483025.371023:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098665984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483025.371050:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483025.371060:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483025.371160:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483025.371192:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483025.371218:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483025.371392:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098666112 00000100:00100000:0.0:1788483025.371397:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098666112 00000100:00100000:0.0:1788483025.371436:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788483025.371444:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098666112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483025.371587:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098666112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483025.371595:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788483025.371668:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483025.371700:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483025.371757:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483025.371783:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788483025.371796:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098666240 00000100:00100000:2.0:1788483025.371800:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098666240 00000100:00100000:2.0:1788483025.371818:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788483025.371824:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098666240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483025.371917:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098666240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483025.371924:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788483025.371963:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483025.372466:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13770:1875360098666368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483025.372511:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483025.372537:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098666368 00000100:00100000:2.0:1788483025.372541:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098666368 00000100:00100000:2.0:1788483025.372564:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788483025.372571:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:13770:x1875360098666368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483025.372659:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:13770:x1875360098666368:12345-0@lo:502:llog_process_th.0 Request processed in 88us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483025.372666:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788483025.372703:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483025.372942:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13770:1875360098666368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788483025.372971:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483025.372989:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483025.372991:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788483025.372999:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69e00f6800 00000020:00000080:2.0:1788483025.373001:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483025.373185:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483025.373190:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483025.373191:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788483025.373195:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483025.373197:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483025.373199:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788483025.373202:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69e00f6800 00000020:00000080:2.0:1788483025.373205:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788483025.373241:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13770:1875360098666496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483025.375138:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483025.375202:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecd50900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483025.375391:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098666496 00000100:00100000:3.0:1788483025.375402:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098666496 00000100:00100000:3.0:1788483025.375469:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788483025.375481:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:13770:x1875360098666496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483025.375653:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:13770:x1875360098666496:12345-0@lo:502:llog_process_th.0 Request processed in 174us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483025.375662:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788483025.375885:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13770:1875360098666496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788483025.375923:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483025.375931:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483025.375934:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788483025.375938:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788483025.377556:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788483025.377595:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483025.377609:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.377622:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483025.377636:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788483025.377639:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69c5051000 from 7 10000000:01000000:3.0:1788483025.377642:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483025.377692:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.377701:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.377728:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483025.377756:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.377838:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.377892:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483025.377947:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098666624 00000100:00100000:0.0:1788483025.377955:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098666624 00000100:00100000:0.0:1788483025.378088:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788483025.378166:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:6491:x1875360098666624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483025.378182:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483025.378198:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1a839 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a832 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483025.378225:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1a839 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a832 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483025.378236:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1a839 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a832 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483025.378245:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8e00, rc 0) 00000100:00100000:0.0:1788483025.379146:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098666624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 979us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483025.379157:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788483025.379274:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483025.379364:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.379375:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483025.379467:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.379508:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.379749:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483025.379832:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098666752 00000100:00100000:2.0:1788483025.379839:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098666752 00000100:00100000:2.0:1788483025.379878:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788483025.379887:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098666752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483025.380196:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098666752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483025.380204:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788483025.380371:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.380409:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.380463:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.380488:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483025.381132:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098666880 00000100:00100000:0.0:1788483025.381140:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098666880 00000100:00100000:0.0:1788483025.381191:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788483025.381200:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098666880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483025.381413:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098666880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483025.381421:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788483025.381536:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098666880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483025.382213:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13771:1875360098667008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483025.383238:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.383359:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483025.383483:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667008 00000100:00100000:2.0:1788483025.383493:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667008 00000100:00100000:2.0:1788483025.383554:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788483025.383565:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:13771:x1875360098667008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483025.384134:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:13771:x1875360098667008:12345-0@lo:502:llog_process_th.0 Request processed in 568us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483025.384144:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788483025.388554:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13771:1875360098667008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483025.388622:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483025.388643:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.388646:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483025.388654:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69c5051000 00000020:00000080:3.0:1788483025.388657:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483025.388780:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483025.388785:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.388786:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483025.388790:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483025.388792:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.388794:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788483025.388798:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69c5051000 00000020:00000080:3.0:1788483025.388800:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788483025.392509:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13771:1875360098667136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483025.392617:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.392673:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483025.393579:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667136 00000100:00100000:1.0:1788483025.393593:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667136 00000100:00100000:1.0:1788483025.393666:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788483025.393678:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:13771:x1875360098667136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483025.393863:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:13771:x1875360098667136:12345-0@lo:502:llog_process_th.0 Request processed in 187us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483025.393871:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788483025.394047:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13771:1875360098667136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483025.394086:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483025.394112:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.394114:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788483025.394120:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788483025.394200:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788483025.394225:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483025.394236:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.394249:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483025.394261:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788483025.394265:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d20cc000 from 7 10000000:01000000:3.0:1788483025.394716:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483025.394760:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.394771:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.394782:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483025.394804:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098667264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.394855:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.394899:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483025.395295:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667264 00000100:00100000:3.0:1788483025.395303:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667264 00000100:00100000:3.0:1788483025.395347:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788483025.395355:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:6491:x1875360098667264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483025.395368:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483025.395382:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a847 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1a840 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.395410:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a840 expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.395421:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a840 expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.395431:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76600, rc 0) 00000100:00100000:3.0:1788483025.395469:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098667264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483025.395489:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788483025.395529:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098667264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483025.395542:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483025.395552:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483025.395620:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098667392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.395650:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.395672:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483025.395686:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667392 00000100:00100000:3.0:1788483025.395689:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667392 00000100:00100000:3.0:1788483025.395710:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788483025.395715:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098667392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.395839:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098667392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483025.395846:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788483025.395872:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098667392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.395896:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098667520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.395935:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.395945:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483025.395955:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667520 00000100:00100000:3.0:1788483025.395958:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667520 00000100:00100000:3.0:1788483025.395973:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788483025.395983:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098667520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.396080:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:6491:x1875360098667520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483025.396087:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788483025.396159:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0f2a9dc-d80b-4f65-b90d-3174e3881641:6491:1875360098667520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483025.396352:0:13773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13773:1875360098667648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483025.396384:0:13773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.396400:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667648 00000100:00100000:3.0:1788483025.396403:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667648 00000100:00100000:3.0:1788483025.396422:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788483025.396427:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:13773:x1875360098667648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483025.396488:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:13773:x1875360098667648:12345-0@lo:502:llog_process_th.0 Request processed in 60us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483025.396495:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788483025.396526:0:13773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483025.396535:0:13773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13773:1875360098667648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483025.396554:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483025.396565:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.396567:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483025.396577:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69d20cc000 00000020:00000080:3.0:1788483025.396579:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:0.0:1788483025.398487:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:3.0:1788483025.400998:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483025.401261:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.401265:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483025.401272:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483025.401347:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483025.401360:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788483025.401369:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69d20cc000 00000020:00000080:3.0:1788483025.401372:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788483025.401492:0:13773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13773:1875360098667776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483025.401601:0:13773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.401943:0:13773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788483025.404253:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667776 00000100:00100000:1.0:1788483025.404274:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667776 00000100:00100000:1.0:1788483025.405288:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788483025.405306:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:13773:x1875360098667776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483025.405524:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:13773:x1875360098667776:12345-0@lo:502:llog_process_th.0 Request processed in 223us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483025.405534:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788483025.406575:0:13773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0f2a9dc-d80b-4f65-b90d-3174e3881641:13773:1875360098667776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788483025.406634:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483025.406646:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483025.406649:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788483025.406654:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788483025.406868:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788483025.406896:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483025.406909:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483025.406922:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483025.418313:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788483025.656581:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483025.656613:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098667904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483025.656714:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483025.656827:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098667904 00000100:00100000:2.0:1788483025.656838:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098667904 00000100:00100000:2.0:1788483025.656904:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788483025.656914:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098667904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483025.656962:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483025.657029:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098667904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483025.657046:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1788483025.657125:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f15f80 x1875360098667904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483025.657160:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098667904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483025.657604:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098668032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483025.657650:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483025.657752:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668032 00000100:00100000:3.0:1788483025.657758:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668032 00000100:00100000:3.0:1788483025.657802:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788483025.657811:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098668032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788483025.657842:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788483025.657886:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098668032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483025.657893:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788483025.657925:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098668032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483025.659391:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098668160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483025.659457:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483025.664319:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668160 00000100:00100000:2.0:1788483025.664338:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668160 00000100:00100000:2.0:1788483025.664422:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788483025.664450:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098668160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483025.664484:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483025.664597:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098668160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (5139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483025.664604:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1788483025.664970:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f15f80 x1875360098668160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483025.664996:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098668160:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483026.040770:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483026.425925:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788483026.426876:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483027.065680:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483027.086263:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483027.086370:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483027.086406:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483027.086440:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483027.086498:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483027.086524:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483027.086567:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044352 00000100:00100000:3.0:1788483027.086579:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044352 00000100:00100000:3.0:1788483027.086642:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044608 00000100:00100000:3.0:1788483027.086646:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044608 00000100:00100000:3.0:1788483027.086791:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044224 00000100:00100000:3.0:1788483027.086795:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044224 00000100:00100000:3.0:1788483027.086809:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044736 00000100:00100000:3.0:1788483027.086812:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044736 00000100:00100000:3.0:1788483027.086844:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 229 00000100:00100000:3.0:1788483027.086856:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044352:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483027.087622:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044352:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 764us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483027.087633:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 229 00000100:00100000:0.0:1788483027.087778:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 230 00000100:00100000:0.0:1788483027.087793:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087044608:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483027.087847:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087044608:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 61us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483027.087854:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 230 00000100:00100000:0.0:1788483027.087872:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 231 00000100:00100000:0.0:1788483027.087878:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044224:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483027.087918:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044224:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 40us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483027.087924:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 231 00000100:00100000:0.0:1788483027.087937:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 232 00000100:00100000:0.0:1788483027.087961:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087044736:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483027.087996:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087044736:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 37us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483027.088320:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044480 00000100:00100000:3.0:1788483027.088329:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044480 00000100:00100000:3.0:1788483027.088374:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 97 00000100:00100000:3.0:1788483027.088381:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044480:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483027.088413:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044480:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 32us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483027.088419:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 97 00000100:00080000:3.0:1788483027.088443:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483027.088448:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483027.088451:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788483027.089803:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 232 00000100:00100000:1.0:1788483027.090563:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044096 00000100:00100000:1.0:1788483027.090577:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044096 00000100:00100000:1.0:1788483027.090645:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 371 00000100:00100000:1.0:1788483027.090768:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087044096:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483027.091352:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087044096:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 587us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483027.091362:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 371 00010000:00010000:1.0:1788483028.088363:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483028.216644:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483028.216675:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098668288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483028.216788:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483028.216970:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668288 00000100:00100000:1.0:1788483028.216982:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668288 00000100:00100000:1.0:1788483028.217056:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788483028.217069:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098668288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483028.217129:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788483028.217184:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098668288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483028.217192:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788483028.230397:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098668288:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788483028.737629:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1788483029.112339:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483029.240699:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098668544:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.240795:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.240884:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098669056:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.240911:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.240937:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098669568:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.240961:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.240985:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788483029.240991:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098668672:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241029:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483029.241050:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668544 00000100:00100000:1.0:1788483029.241050:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098669184:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241060:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668544 00000100:00100000:1.0:1788483029.241070:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.241085:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098669696:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241127:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483029.241129:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669056 00000100:00100000:3.0:1788483029.241132:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669056 00000100:00100000:1.0:1788483029.241142:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098670080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483029.241157:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669568 00000100:00100000:3.0:1788483029.241160:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669568 00000100:00100000:1.0:1788483029.241166:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483029.241175:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669184 00000100:00100000:3.0:1788483029.241177:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669184 00000100:00100000:3.0:1788483029.241190:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669696 00000100:00100000:3.0:1788483029.241192:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669696 00000100:00100000:3.0:1788483029.241210:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788483029.241219:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098668544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241277:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098668544:12345-0@lo:400:kworker.0 Request processed in 59us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483029.241285:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788483029.241304:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788483029.241310:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098669056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241335:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098669056:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483029.241341:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788483029.241341:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098668544:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241351:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788483029.241357:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098669568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241372:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098669056:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241382:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098669568:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483029.241382:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098669568:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241388:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788483029.241407:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788483029.241413:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098669184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241417:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668672 00000100:00100000:1.0:1788483029.241420:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668672 00000100:00100000:3.0:1788483029.241446:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098669184:12345-0@lo:400:kworker.0 Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483029.241448:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788483029.241452:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788483029.241454:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098668672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241463:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788483029.241469:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098669696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241487:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098668672:12345-0@lo:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483029.241491:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098669696:12345-0@lo:400:kworker.0 Request processed in 23us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483029.241494:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788483029.241496:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1788483029.241512:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483029.241516:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483029.241521:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098668672:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241531:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098668416:0@lo:400:kworker.0 00010000:00080000:1.0:1788483029.241534:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3745c00 x1875360098669184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483029.241545:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098669184:0@lo:400:kworker.0 00010000:00080000:1.0:1788483029.241553:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3744000 x1875360098669696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483029.241561:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.241562:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098669696:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241580:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668416 00000100:00100000:3.0:1788483029.241584:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098668928:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241584:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668416 00000100:00100000:3.0:1788483029.241605:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.241611:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788483029.241617:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098668416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241618:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098669440:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241642:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.241645:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098668416:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483029.241651:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788483029.241658:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098669952:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241676:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483029.241700:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098668416:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241705:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669440 00000100:00100000:3.0:1788483029.241708:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788483029.241708:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669440 00000100:00100000:3.0:1788483029.241714:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098668800:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241737:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669952 00000100:00100000:3.0:1788483029.241738:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.241740:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669952 00000100:00100000:3.0:1788483029.241752:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098669312:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241759:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788483029.241765:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098669440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241782:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.241790:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098669440:12345-0@lo:400:kworker.0 Request processed in 26us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483029.241793:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098669824:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.241796:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788483029.241805:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669312 00000100:00100000:1.0:1788483029.241807:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669312 00000100:00100000:3.0:1788483029.241811:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483029.241820:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098669824 00000100:00100000:1.0:1788483029.241822:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098669824 00010000:00080000:3.0:1788483029.241826:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3746d80 x1875360098669440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483029.241835:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098669440:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241854:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668800 00000100:00100000:3.0:1788483029.241857:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668800 00000100:00100000:3.0:1788483029.241875:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788483029.241880:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098668800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.241911:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098668800:12345-0@lo:400:kworker.0 Request processed in 31us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483029.241916:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788483029.241928:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670080 00000100:00100000:2.0:1788483029.241932:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670080 00000100:00100000:3.0:1788483029.241937:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098668800:0@lo:400:kworker.0 00000100:00100000:0.0:1788483029.242034:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788483029.242044:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098669952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483029.242086:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098669952:12345-0@lo:400:kworker.0 Request processed in 45us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483029.242091:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788483029.242123:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788483029.242129:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098669312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483029.242157:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098669312:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483029.242162:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1788483029.242188:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3744380 x1875360098669312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483029.242209:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098669312:0@lo:400:kworker.0 00000100:00100000:0.0:1788483029.242219:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788483029.242224:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a68c3e78a80, transno 4294967301 00000100:00100000:0.0:1788483029.242236:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098669952:0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.242368:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788483029.242375:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098669824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483029.242411:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098669824:12345-0@lo:400:kworker.0 Request processed in 37us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483029.242416:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788483029.242432:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483029.242435:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483029.242457:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098669824:0@lo:400:kworker.0 00000100:00100000:2.0:1788483029.249590:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788483029.249623:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098670080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788483029.249672:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483029.249793:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098670080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (8624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483029.249816:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788483029.249866:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098668928 00000100:00100000:2.0:1788483029.249876:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098668928 00000100:00100000:2.0:1788483029.249924:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788483029.249931:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098668928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483029.249976:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098668928:12345-0@lo:400:kworker.0 Request processed in 46us (8370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483029.249984:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788483029.250057:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098670080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483029.253745:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098668928:0@lo:400:kworker.0 00000100:00100000:3.0:1788483029.760693:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098670208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483029.760810:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483029.761065:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670208 00000100:00100000:0.0:1788483029.761075:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670208 00000100:00100000:0.0:1788483029.761159:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788483029.761170:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098670208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483029.761220:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483029.761287:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098670208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483029.761295:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788483029.761917:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098670208:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788483030.136465:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483030.776614:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098670336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483030.776715:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483030.776802:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483030.776809:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098670464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483030.776835:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483030.776872:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670336 00000100:00100000:3.0:1788483030.776898:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670336 00000100:00100000:3.0:1788483030.776952:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670464 00000100:00100000:3.0:1788483030.776956:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670464 00000100:00100000:3.0:1788483030.776977:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788483030.776988:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098670336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483030.777048:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483030.777141:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098670336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483030.777148:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788483030.777167:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788483030.777174:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098670464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483030.777186:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483030.777210:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098670464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483030.777216:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788483030.777255:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd935f80 x1875360098670464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483030.777277:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098670464:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788483030.777290:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f15f80 x1875360098670336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483030.777302:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098670336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483030.777792:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098670592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483030.777836:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483030.777913:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670592 00000100:00100000:1.0:1788483030.777927:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670592 00000100:00100000:1.0:1788483030.777965:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788483030.777972:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098670592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483030.778006:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483030.778076:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098670592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483030.778129:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788483030.778171:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098670592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788483031.160311:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483032.188899:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483032.212412:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483032.212518:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483032.212556:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483032.212592:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483032.212647:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483032.212682:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483032.212715:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087045248 00000100:00100000:3.0:1788483032.212740:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087045248 00000100:00100000:3.0:1788483032.212834:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 102 00000100:00100000:3.0:1788483032.212847:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087045248:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483032.212937:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087045248:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483032.212945:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 102 00000100:00080000:3.0:1788483032.213136:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483032.213352:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087045120 00000100:00100000:2.0:1788483032.213359:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087045120 00000100:00100000:2.0:1788483032.213407:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087045376 00000100:00100000:2.0:1788483032.213410:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087045376 00000100:00100000:2.0:1788483032.213421:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044992 00000100:00100000:2.0:1788483032.213424:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044992 00000100:00100000:2.0:1788483032.213435:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087045504 00000100:00100000:2.0:1788483032.213436:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087045504 00000100:00100000:2.0:1788483032.213449:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 239 00000100:00100000:2.0:1788483032.213467:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087045120:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483032.213510:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087045120:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 55us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483032.213517:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 239 00000100:00100000:2.0:1788483032.213530:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 240 00000100:00100000:2.0:1788483032.213535:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087045376:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483032.213555:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087045376:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 20us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483032.213561:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 240 00000100:00100000:2.0:1788483032.213570:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 241 00000100:00100000:2.0:1788483032.213575:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044992:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483032.213594:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087044992:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 19us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483032.213600:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 241 00000100:00100000:2.0:1788483032.213608:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 242 00000100:00100000:2.0:1788483032.213613:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087045504:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483032.213630:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087045504:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 17us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483032.213644:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 242 00000100:00080000:3.0:1788483032.213982:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483032.213986:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483032.214437:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087044864 00000100:00100000:1.0:1788483032.214448:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087044864 00000100:00100000:1.0:1788483032.214560:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 373 00000100:00100000:1.0:1788483032.214580:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087044864:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483032.214636:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087044864:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 68us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483032.214644:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 373 00010000:00010000:3.0:1788483033.208773:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483033.341053:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098670720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483033.341475:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483033.341986:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670720 00000100:00100000:2.0:1788483033.342008:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670720 00000100:00100000:2.0:1788483033.342080:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788483033.342115:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098670720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483033.342163:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788483033.342255:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098670720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483033.342263:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788483033.342495:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098670720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788483034.232493:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483034.360519:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098671232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483034.360628:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.360632:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098670976:0@lo:400:kworker.0 00000100:00100000:3.0:1788483034.360712:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098671232 00000100:00100000:2.0:1788483034.360721:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098671744:0@lo:400:kworker.0 00000100:00100000:3.0:1788483034.360723:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098671232 00000100:00100000:0.0:1788483034.360797:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788483034.360884:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788483034.360897:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098671232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483034.360947:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483034.361620:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.361655:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098671488:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.361686:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.361703:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098672000:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.361725:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.361740:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098672512:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.361757:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.361777:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788483034.361782:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098670848:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.361807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.361831:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098671360:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.361851:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.361885:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098671872:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362026:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.362048:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098672384:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362069:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.362307:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098671488 00000100:00100000:1.0:1788483034.362314:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098671488 00000100:00100000:1.0:1788483034.362372:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788483034.362381:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098671488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362438:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098671488:12345-0@lo:400:kworker.0 Request processed in 58us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.362446:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788483034.362473:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672000 00000100:00100000:1.0:1788483034.362476:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672000 00000100:00100000:1.0:1788483034.362497:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672512 00000100:00100000:1.0:1788483034.362499:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672512 00000100:00100000:1.0:1788483034.362510:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098671872 00000100:00100000:1.0:1788483034.362511:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098671872 00000100:00100000:1.0:1788483034.362521:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672384 00000100:00100000:1.0:1788483034.362524:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672384 00000100:00100000:1.0:1788483034.362537:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788483034.362542:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098672000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362572:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098672000:12345-0@lo:400:kworker.0 Request processed in 30us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.362578:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788483034.362589:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788483034.362594:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098672512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362615:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098672512:12345-0@lo:400:kworker.0 Request processed in 22us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.362631:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788483034.362641:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788483034.362645:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098671872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362669:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098671872:12345-0@lo:400:kworker.0 Request processed in 23us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.362674:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788483034.362682:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788483034.362687:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098672384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362709:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098672384:12345-0@lo:400:kworker.0 Request processed in 22us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.362715:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788483034.362738:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670848 00000100:00100000:1.0:1788483034.362742:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670848 00000100:00100000:1.0:1788483034.362773:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788483034.362780:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098670848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362806:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098670848:12345-0@lo:400:kworker.0 Request processed in 28us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.362811:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788483034.362878:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098670848:0@lo:400:kworker.0 00010000:00080000:1.0:1788483034.362895:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb86a00 x1875360098671872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483034.362920:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098671872:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362933:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098672384:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362942:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098671488:0@lo:400:kworker.0 00010000:00080000:1.0:1788483034.362970:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87b80 x1875360098672000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483034.362980:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098672000:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.362990:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098672512:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.363058:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098670976 00000100:00100000:1.0:1788483034.363061:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098670976 00000100:00100000:1.0:1788483034.363526:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098671360 00000100:00100000:1.0:1788483034.363531:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098671360 00000100:00100000:1.0:1788483034.363562:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788483034.363570:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098670976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.363626:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098670976:12345-0@lo:400:kworker.0 Request processed in 57us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.363634:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788483034.363648:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788483034.363653:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098671360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.363681:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098671360:12345-0@lo:400:kworker.0 Request processed in 28us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.363688:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788483034.363725:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098671360:0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.363739:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098670976:0@lo:400:kworker.0 00000100:00080000:1.0:1788483034.363819:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483034.363824:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483034.368873:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483034.368893:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.369071:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098671744 00000100:00100000:1.0:1788483034.369241:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098671744 00000100:00100000:1.0:1788483034.369321:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788483034.369355:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098671744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.369446:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098671744:12345-0@lo:400:kworker.0 Request processed in 97us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.369454:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788483034.369482:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483034.369590:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098671232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8694us (8961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483034.369599:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788483034.369703:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098671616:0@lo:400:kworker.0 00000100:00100000:0.0:1788483034.369743:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483034.369850:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098672128:0@lo:400:kworker.0 00000100:00100000:0.0:1788483034.369876:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483034.370266:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098671616 00000100:00100000:0.0:1788483034.370272:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098671616 00000100:00100000:0.0:1788483034.370312:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672128 00000100:00100000:0.0:1788483034.370315:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672128 00000100:00100000:0.0:1788483034.370337:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788483034.370344:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098671616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483034.370388:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098671616:12345-0@lo:400:kworker.0 Request processed in 44us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483034.370395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788483034.370410:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788483034.370416:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098672128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483034.370445:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098672128:12345-0@lo:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483034.370451:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1788483034.370469:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788483034.370497:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb85500 x1875360098671744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483034.370501:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098672128:0@lo:400:kworker.0 00000100:00100000:2.0:1788483034.370514:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098671744:0@lo:400:kworker.0 00000100:00100000:2.0:1788483034.370528:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098672256:0@lo:400:kworker.0 00000100:00100000:0.0:1788483034.370554:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098671616:0@lo:400:kworker.0 00000100:00100000:2.0:1788483034.370563:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483034.370648:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098671104 00000100:00100000:1.0:1788483034.370653:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098671104 00000100:00100000:1.0:1788483034.370685:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788483034.370692:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098671104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483034.370736:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098671104:12345-0@lo:400:kworker.0 Request processed in 44us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.370742:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788483034.370952:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672256 00000100:00100000:3.0:1788483034.371030:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672256 00000100:00100000:3.0:1788483034.371068:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788483034.371222:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098672256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483034.371263:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098672256:12345-0@lo:400:kworker.0 Request processed in 43us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483034.371269:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:3.0:1788483034.371287:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483034.371443:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098671104:0@lo:400:kworker.0 00010000:00080000:2.0:1788483034.374248:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ecc26300 x1875360098672256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483034.374269:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098672256:0@lo:400:kworker.0 00000100:00100000:2.0:1788483034.374301:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098671232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483034.875010:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483034.875051:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098672640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483034.875157:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483034.875231:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672640 00000100:00100000:2.0:1788483034.875242:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672640 00000100:00100000:2.0:1788483034.875318:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788483034.875331:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098672640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788483034.875372:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483034.875432:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098672640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483034.875441:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788483034.875498:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098672640:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788483035.257955:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483035.896386:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098672768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483035.896471:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483035.896720:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672768 00000100:00100000:1.0:1788483035.896735:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672768 00000100:00100000:3.0:1788483035.897089:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098672896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483035.897145:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483035.897186:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098672896 00000100:00100000:3.0:1788483035.897193:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098672896 00000100:00100000:3.0:1788483035.897232:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788483035.897241:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098672896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483035.897267:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483035.897327:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098672896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483035.897337:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1788483035.897355:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ecc24e00 x1875360098672896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483035.897356:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788483035.897381:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098672768:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483035.897383:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098672896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483035.897436:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483035.897455:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098673024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483035.897491:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788483035.897717:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483035.897801:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098672768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 429us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483035.897809:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788483035.897975:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098672768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483035.899949:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673024 00000100:00100000:3.0:1788483035.899960:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673024 00000100:00100000:3.0:1788483035.900214:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788483035.900225:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098673024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483035.900248:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483035.900333:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098673024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483035.900341:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788483035.900463:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3c78000 x1875360098673024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483035.900494:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098673024:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483036.281035:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483036.665547:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788483036.665852:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788483037.304313:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483037.325791:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483037.325832:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483037.325866:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483037.325889:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483037.325906:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483037.325928:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483037.325955:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087045760 00000100:00100000:0.0:1788483037.325963:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087045760 00000100:00100000:0.0:1788483037.326020:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046272 00000100:00100000:0.0:1788483037.326023:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046272 00000100:00100000:0.0:1788483037.326035:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087045888 00000100:00100000:0.0:1788483037.326037:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087045888 00000100:00100000:0.0:1788483037.326048:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046144 00000100:00100000:0.0:1788483037.326051:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046144 00000100:00100000:0.0:1788483037.326067:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 249 00000100:00100000:0.0:1788483037.326076:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087045760:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483037.326174:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087045760:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.326183:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 249 00000100:00100000:0.0:1788483037.326199:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 250 00000100:00100000:0.0:1788483037.326204:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087046272:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483037.326245:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087046272:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 40us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.326252:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 250 00000100:00100000:3.0:1788483037.326268:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046016 00000100:00100000:0.0:1788483037.326268:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 251 00000100:00100000:3.0:1788483037.326275:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046016 00000100:00100000:0.0:1788483037.326276:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087045888:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483037.326306:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087045888:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.326313:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 251 00000100:00100000:3.0:1788483037.326325:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 107 00000100:00100000:0.0:1788483037.326332:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 252 00000100:00100000:3.0:1788483037.326337:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087046016:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483037.326344:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087046144:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483037.326379:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087046016:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 45us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.326383:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2392:x1875360087046144:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 41us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483037.326393:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 107 00000100:00100000:0.0:1788483037.326397:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 252 00000100:00080000:3.0:1788483037.326448:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483037.326453:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483037.326457:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483037.326670:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087045632 00000100:00100000:1.0:1788483037.326675:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087045632 00000100:00100000:1.0:1788483037.326712:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 375 00000100:00100000:1.0:1788483037.326720:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2392:x1875360087045632:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483037.326780:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2392:x1875360087045632:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 61us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483037.326786:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 375 00010000:00010000:3.0:1788483038.328417:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483038.456467:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098673152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483038.456545:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483038.456679:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673152 00000100:00100000:0.0:1788483038.456699:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673152 00000100:00100000:0.0:1788483038.456750:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788483038.456759:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098673152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483038.456799:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788483038.456846:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098673152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483038.456852:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788483038.457016:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098673152:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483039.355387:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483039.480444:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098673280:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.480477:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098673664:0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.480543:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098673536:0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.480555:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098673408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483039.481492:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.481550:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098674048:0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.481588:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.481614:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098674560:0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.481633:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.481674:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673536 00000100:00100000:0.0:1788483039.481680:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673536 00000100:00100000:0.0:1788483039.481722:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674048 00000100:00100000:0.0:1788483039.481725:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674048 00000100:00100000:0.0:1788483039.481746:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674560 00000100:00100000:0.0:1788483039.481749:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674560 00000100:00100000:0.0:1788483039.481764:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788483039.481771:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098673536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.481819:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098673536:12345-0@lo:400:kworker.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.481826:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788483039.481842:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788483039.481849:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098674048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.481876:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098674048:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.481882:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788483039.481893:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788483039.481898:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.481899:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098674560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.481922:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098674560:12345-0@lo:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.481928:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:0.0:1788483039.481942:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483039.482236:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483039.482807:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098674176:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.482848:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483039.482853:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098673920:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.482872:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098674688:0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.482904:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483039.482910:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483039.482933:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098674432:0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.482959:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483039.483003:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673408 00000100:00100000:2.0:1788483039.483008:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673408 00000100:00100000:1.0:1788483039.483021:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788483039.483049:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788483039.483058:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098673408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788483039.483080:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483039.483131:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098673408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.483138:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788483039.483227:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483039.483237:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673664 00000100:00100000:2.0:1788483039.483240:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673664 00000100:00100000:2.0:1788483039.483336:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673920 00000100:00100000:2.0:1788483039.483340:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673920 00000100:00100000:2.0:1788483039.483356:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788483039.483361:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098673664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.483394:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098673664:12345-0@lo:400:kworker.0 Request processed in 33us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.483400:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788483039.483410:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788483039.483415:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098673920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.483441:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098673920:12345-0@lo:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.483446:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788483039.483466:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098674944:0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.483860:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483039.483916:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098673408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483039.483926:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098673920:0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.483976:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674176 00000100:00100000:2.0:1788483039.483980:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674176 00000100:00100000:2.0:1788483039.484004:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674688 00000100:00100000:2.0:1788483039.484006:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674688 00000100:00100000:2.0:1788483039.484020:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788483039.484025:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098674176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.484055:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098674176:12345-0@lo:400:kworker.0 Request processed in 30us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.484061:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788483039.484074:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788483039.484079:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098674688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.484131:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098674688:12345-0@lo:400:kworker.0 Request processed in 52us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.484137:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:2.0:1788483039.484219:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788483039.484245:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674432 00000100:00100000:2.0:1788483039.484249:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674432 00000100:00100000:2.0:1788483039.484366:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674944 00000100:00100000:2.0:1788483039.484369:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674944 00000100:00100000:2.0:1788483039.484386:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788483039.484392:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098674432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.484424:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098674432:12345-0@lo:400:kworker.0 Request processed in 33us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.484440:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788483039.484452:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788483039.484458:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098674944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.484484:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098674944:12345-0@lo:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.484632:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788483039.484653:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788483039.484678:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f23800 x1875360098674432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483039.484689:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098674432:0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.484699:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098674944:0@lo:400:kworker.0 00000100:00100000:3.0:1788483039.484904:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483039.485012:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673280 00000100:00100000:2.0:1788483039.485017:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673280 00000100:00100000:2.0:1788483039.485059:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788483039.485066:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098673280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.485083:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098673536:0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.485138:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098674048:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.488702:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098673792:0@lo:400:kworker.0 00000100:00100000:2.0:1788483039.495318:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098673280:12345-0@lo:400:kworker.0 Request processed in 10243us (10405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483039.495333:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788483039.497458:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098674560:0@lo:400:kworker.0 00000100:00100000:3.0:1788483039.498951:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098673280:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.499205:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483039.499251:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098674304:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.499281:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483039.499306:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098674816:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.499326:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483039.499353:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674304 00000100:00100000:0.0:1788483039.499475:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098674816 00000100:00100000:0.0:1788483039.499482:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674816 00000100:00100000:0.0:1788483039.499534:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788483039.499543:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098674816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.499590:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098674816:12345-0@lo:400:kworker.0 Request processed in 47us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.499597:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788483039.499640:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098674816:0@lo:400:kworker.0 00010000:00080000:0.0:1788483039.499654:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22300 x1875360098674176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483039.499663:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098674176:0@lo:400:kworker.0 00010000:00080000:0.0:1788483039.499673:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20000 x1875360098674688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483039.499681:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098674688:0@lo:400:kworker.0 00000100:00100000:0.0:1788483039.499692:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098673664:0@lo:400:kworker.0 00000100:00080000:2.0:1788483039.499818:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483039.499875:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098673792 00000100:00100000:3.0:1788483039.499880:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098673792 00000100:00100000:3.0:1788483039.499913:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788483039.499919:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098673792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483039.499963:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098673792:12345-0@lo:400:kworker.0 Request processed in 43us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483039.499977:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788483039.500087:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098673792:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.500626:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098674304 00000100:00080000:2.0:1788483039.500890:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483039.501009:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788483039.501022:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098674304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.501328:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098674304:12345-0@lo:400:kworker.0 Request processed in 309us (2045us total) trans 0 rc 0/0 00010000:00080000:2.0:1788483039.501409:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20e00 x1875360098674304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483039.501422:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098674304:0@lo:400:kworker.0 00000100:00100000:1.0:1788483039.511796:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788483039.994798:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483039.994822:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098675072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483039.994886:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483039.995026:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675072 00000100:00100000:1.0:1788483039.995034:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675072 00000100:00100000:1.0:1788483039.995084:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788483039.995093:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098675072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483039.995134:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483039.995187:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098675072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483039.995206:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788483039.995347:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098675072:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788483040.376368:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483041.017720:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098675328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483041.017793:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483041.017864:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483041.017871:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098675200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483041.017900:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483041.017934:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675200 00000100:00100000:1.0:1788483041.017941:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675200 00000100:00100000:3.0:1788483041.017965:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675328 00000100:00100000:3.0:1788483041.017972:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675328 00000100:00100000:1.0:1788483041.018001:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788483041.018011:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098675200:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483041.018024:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788483041.018034:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098675328:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1788483041.018043:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:3.0:1788483041.018072:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483041.018091:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098675200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483041.018121:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788483041.018168:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098675200:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788483041.018182:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ecc26680 x1875360098675328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483041.018202:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098675328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483041.018223:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098675328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483041.018233:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788483041.018239:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098675456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483041.018266:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483041.018303:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675456 00000100:00100000:3.0:1788483041.018309:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675456 00000100:00100000:3.0:1788483041.018355:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788483041.018363:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098675456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483041.018374:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483041.018997:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098675456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 632us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483041.019005:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788483041.019727:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788483041.026007:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3745f80 x1875360098675456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483041.026038:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098675456:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483041.401118:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483042.424404:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483042.453457:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483042.453573:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483042.453610:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483042.453840:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046656 00000100:00100000:2.0:1788483042.453850:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046656 00000100:00100000:2.0:1788483042.453909:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046528 00000100:00100000:2.0:1788483042.453913:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046528 00000100:00100000:2.0:1788483042.453947:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 259 00000100:00100000:2.0:1788483042.453966:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087046656:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483042.454035:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087046656:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 70us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483042.454042:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 259 00000100:00100000:2.0:1788483042.454058:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 260 00000100:00100000:2.0:1788483042.454064:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087046528:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483042.454089:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087046528:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483042.454125:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 260 00000100:00080000:0.0:1788483042.454969:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483042.454974:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483042.455316:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046400 00000100:00100000:1.0:1788483042.455324:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046400 00000100:00100000:1.0:1788483042.455468:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 377 00000100:00100000:1.0:1788483042.455478:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087046400:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483042.455536:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087046400:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 60us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483042.455543:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 377 00000100:00100000:0.0:1788483042.464757:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483042.464801:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483042.464836:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483042.465031:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046912 00000100:00100000:3.0:1788483042.465041:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046912 00000100:00100000:3.0:1788483042.465130:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047040 00000100:00100000:3.0:1788483042.465134:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047040 00000100:00100000:3.0:1788483042.465161:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 261 00000100:00100000:3.0:1788483042.465171:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087046912:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483042.465262:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087046912:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 93us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483042.465269:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 261 00000100:00100000:3.0:1788483042.465299:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 262 00000100:00100000:3.0:1788483042.465307:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087047040:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483042.465332:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087047040:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 27us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483042.465353:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 262 00000100:00100000:2.0:1788483042.466205:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087046784 00000100:00100000:2.0:1788483042.466213:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087046784 00000100:00100000:2.0:1788483042.466265:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:2.0:1788483042.466274:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2389:x1875360087046784:12345-192.168.206.54@tcp:9:kworker.0 00000020:00000080:2.0:1788483042.466295:0:8551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a76e 00000100:00080000:2.0:1788483042.466303:0:8551:0:(import.c:65:import_set_state_nolock()) ffff9a69efd44800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483042.466347:0:8551:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788483042.466502:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+2:2389:x1875360087046784:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 229us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483042.466510:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 27 00010000:00010000:1.0:1788483042.467347:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483042.467526:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483042.467531:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483042.467534:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788483043.449636:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483043.576558:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483043.576579:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098675584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483043.576643:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483043.576763:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675584 00000100:00100000:2.0:1788483043.576770:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675584 00000100:00100000:2.0:1788483043.576829:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788483043.576838:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098675584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483043.576869:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788483043.576924:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098675584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483043.576931:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788483043.577238:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098675584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483044.472674:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483044.614031:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098675712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483044.614144:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098675968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.614167:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483044.614171:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483044.614269:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098676096:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616014:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098676224:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616077:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.616122:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098676736:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616162:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.616189:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098677248:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616211:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.616232:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788483044.616238:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098675840:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616264:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.616287:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098676352:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616310:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.616326:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098676864:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616346:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.616362:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098677376:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616380:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.616410:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675712 00000100:00100000:3.0:1788483044.616417:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675712 00000100:00100000:3.0:1788483044.616469:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788483044.616478:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098675712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483044.616514:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483044.616559:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098675712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483044.616566:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788483044.616588:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675968 00000100:00100000:3.0:1788483044.616592:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675968 00000100:00100000:3.0:1788483044.616614:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676224 00000100:00100000:3.0:1788483044.616617:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676224 00000100:00100000:3.0:1788483044.616634:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788483044.616640:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098675968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616672:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098675968:12345-0@lo:400:kworker.0 Request processed in 32us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483044.616678:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788483044.616690:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788483044.616695:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098676224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616721:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098676224:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483044.616726:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788483044.616747:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098675840 00000100:00100000:3.0:1788483044.616750:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098675840 00000100:00100000:3.0:1788483044.616776:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788483044.616782:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098675840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616809:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098675840:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483044.616814:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788483044.616840:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676736 00000100:00100000:3.0:1788483044.616849:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676736 00000100:00100000:3.0:1788483044.616869:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098677248 00000100:00100000:3.0:1788483044.616871:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098677248 00000100:00100000:3.0:1788483044.616882:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676864 00000100:00100000:3.0:1788483044.616885:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676864 00000100:00100000:3.0:1788483044.616895:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098677376 00000100:00100000:3.0:1788483044.616897:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098677376 00000100:00100000:3.0:1788483044.616909:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788483044.616915:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098676736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.616963:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098676736:12345-0@lo:400:kworker.0 Request processed in 48us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483044.616969:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788483044.616981:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788483044.616987:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098677248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617014:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098677248:12345-0@lo:400:kworker.0 Request processed in 28us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483044.617020:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788483044.617030:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788483044.617036:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098676864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.617239:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788483044.617248:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098677376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617251:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098676864:12345-0@lo:400:kworker.0 Request processed in 215us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483044.617256:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788483044.617278:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098677376:12345-0@lo:400:kworker.0 Request processed in 32us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483044.617284:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788483044.617298:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483044.617301:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483044.617303:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098675840:0@lo:400:kworker.0 00010000:00080000:3.0:1788483044.617317:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fad80 x1875360098676864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483044.617329:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098676864:0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.617333:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676352 00000100:00100000:0.0:1788483044.617337:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676352 00000100:00100000:3.0:1788483044.617350:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098677376:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617360:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098676224:0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.617362:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788483044.617368:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098676352:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788483044.617369:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f9f80 x1875360098676736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483044.617377:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098676736:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617386:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098677248:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617399:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ecc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098675712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483044.617400:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098676352:12345-0@lo:400:kworker.0 Request processed in 32us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483044.617415:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788483044.617431:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098676352:0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.617453:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098675968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617489:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098676480:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617516:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483044.617592:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098676992:0@lo:400:kworker.0 00000100:00100000:3.0:1788483044.617615:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483044.617734:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676480 00000100:00100000:0.0:1788483044.617739:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676480 00000100:00100000:0.0:1788483044.617766:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676992 00000100:00100000:0.0:1788483044.617769:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676992 00000100:00100000:0.0:1788483044.617788:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788483044.617794:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098676480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.617829:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098676480:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483044.617835:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788483044.617847:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788483044.617853:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098676992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.617879:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098676992:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483044.617884:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1788483044.617898:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483044.617920:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098676480:0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.617930:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098676992:0@lo:400:kworker.0 00000100:00100000:1.0:1788483044.618137:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483044.618205:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098676608:0@lo:400:kworker.0 00000100:00100000:1.0:1788483044.618242:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483044.618271:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098677120:0@lo:400:kworker.0 00000100:00100000:1.0:1788483044.618293:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483044.618314:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676608 00000100:00100000:1.0:1788483044.618317:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676608 00000100:00100000:1.0:1788483044.618347:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098677120 00000100:00100000:1.0:1788483044.618350:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098677120 00000100:00100000:1.0:1788483044.618378:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788483044.618383:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098676608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483044.618413:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098676608:12345-0@lo:400:kworker.0 Request processed in 30us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483044.618419:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788483044.618430:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788483044.618435:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098677120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483044.618457:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098677120:12345-0@lo:400:kworker.0 Request processed in 22us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483044.618463:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788483044.618478:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788483044.618506:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c376b800 x1875360098677120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483044.618518:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098677120:0@lo:400:kworker.0 00010000:00080000:1.0:1788483044.618536:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f9880 x1875360098676608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483044.618544:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098676608:0@lo:400:kworker.0 00000100:00100000:0.0:1788483044.621411:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098676096 00000100:00100000:0.0:1788483044.621427:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098676096 00000100:00100000:1.0:1788483044.621554:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788483044.621565:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098676096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483044.621658:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098676096:12345-0@lo:400:kworker.0 Request processed in 95us (3522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483044.621665:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788483044.621707:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098676096:0@lo:400:kworker.0 00000100:00100000:1.0:1788483045.115510:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098677504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483045.115586:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483045.115693:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098677504 00000100:00100000:0.0:1788483045.115701:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098677504 00000100:00100000:0.0:1788483045.115755:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788483045.115765:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098677504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483045.115797:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483045.115842:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098677504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483045.115849:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788483045.115920:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098677504:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788483045.496707:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483046.136293:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098677632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483046.136370:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483046.136480:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098677632 00000100:00100000:3.0:1788483046.136491:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098677632 00000100:00100000:3.0:1788483046.136548:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788483046.136557:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098677632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483046.136584:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483046.136623:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098677632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483046.136630:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:3.0:1788483046.136664:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c6233800 x1875360098677632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483046.136697:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098677632:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788483046.136744:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483046.139733:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098677760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483046.139801:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483046.139902:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098677760 00000100:00100000:1.0:1788483046.139910:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098677760 00000100:00100000:1.0:1788483046.139980:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788483046.139988:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098677760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788483046.140009:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483046.140046:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098677760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483046.140052:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1788483046.140162:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788483046.140190:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cf2d80 x1875360098677760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483046.140208:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098677760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483046.140624:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098677888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483046.140663:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483046.140708:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098677888 00000100:00100000:1.0:1788483046.140714:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098677888 00000100:00100000:1.0:1788483046.140754:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788483046.140761:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098677888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483046.140787:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483046.140831:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098677888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483046.140837:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788483046.140944:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098677888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788483046.522162:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483046.905429:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788483046.968994:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483047.544450:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483047.566611:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483047.566637:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483047.566674:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483047.566692:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483047.566726:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483047.566783:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047296 00000100:00100000:1.0:1788483047.566794:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047296 00000100:00100000:1.0:1788483047.566853:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047552 00000100:00100000:1.0:1788483047.566856:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047552 00000100:00100000:1.0:1788483047.566869:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047424 00000100:00100000:1.0:1788483047.566877:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047424 00000100:00100000:1.0:1788483047.566904:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047680 00000100:00100000:1.0:1788483047.566906:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047680 00000100:00100000:1.0:1788483047.566936:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 269 00000100:00100000:1.0:1788483047.566945:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087047296:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483047.567016:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087047296:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 72us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483047.567024:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 269 00000100:00100000:1.0:1788483047.567040:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 270 00000100:00100000:1.0:1788483047.567046:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087047552:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483047.567069:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087047552:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483047.567075:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 270 00000100:00100000:1.0:1788483047.567086:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 271 00000100:00100000:1.0:1788483047.567092:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087047424:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483047.567153:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087047424:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 60us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483047.567159:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 271 00000100:00100000:1.0:1788483047.567171:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 272 00000100:00100000:1.0:1788483047.567177:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087047680:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483047.567199:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087047680:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483047.567205:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 272 00000100:00100000:1.0:1788483047.567223:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047168 00000100:00100000:1.0:1788483047.567231:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047168 00000100:00100000:1.0:1788483047.567252:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 379 00000100:00100000:1.0:1788483047.567257:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087047168:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483047.567279:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087047168:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483047.567285:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 379 00000100:00080000:0.0:1788483047.567584:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483047.567590:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788483048.568260:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483048.696578:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098678016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483048.696668:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483048.696763:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678016 00000100:00100000:0.0:1788483048.696772:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678016 00000100:00100000:0.0:1788483048.696830:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788483048.696839:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098678016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483048.696884:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788483048.696951:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098678016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483048.696960:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788483048.697016:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098678016:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788483048.702744:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:3.0:1788483048.702757:0:9489:0:(genops.c:885:class_export_put()) final put ffff9a69ed824800/d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:1.0:1788483048.702839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ed824800/d93ec387-f41f-455a-afdd-b6a72a2f59de for lustre-OST0001 00000020:00000080:1.0:1788483048.702914:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd44800 for lustre-OST0001 00010000:00010000:3.0:1788483049.593540:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483049.720352:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483049.720377:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098678144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483049.720452:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483049.720973:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098678656:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.721009:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483049.721031:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098679168:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.721055:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483049.721071:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098679680:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.721092:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483049.721131:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788483049.721136:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098678528:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.721162:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483049.721183:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098679040:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.721204:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483049.721218:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098679552:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.721275:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483049.721311:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678528 00000100:00100000:2.0:1788483049.721319:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678528 00000100:00100000:2.0:1788483049.721385:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788483049.721394:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098678528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.721452:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098678528:12345-0@lo:400:kworker.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483049.721468:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788483049.721491:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678656 00000100:00100000:2.0:1788483049.721495:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678656 00000100:00100000:2.0:1788483049.721519:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679040 00000100:00100000:2.0:1788483049.721522:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679040 00000100:00100000:3.0:1788483049.721946:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678144 00000100:00100000:3.0:1788483049.721951:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678144 00000100:00100000:3.0:1788483049.721985:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788483049.721993:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098678144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483049.722017:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483049.722058:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098678144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483049.722064:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788483049.722084:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679168 00000100:00100000:3.0:1788483049.722088:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679168 00000100:00100000:3.0:1788483049.722130:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679680 00000100:00100000:3.0:1788483049.722133:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679680 00000100:00100000:3.0:1788483049.722158:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788483049.722164:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098679168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483049.722196:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098679168:12345-0@lo:400:kworker.0 Request processed in 32us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483049.722202:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788483049.722214:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788483049.722220:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098679680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483049.722247:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098679680:12345-0@lo:400:kworker.0 Request processed in 28us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483049.722254:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788483049.722320:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098678528:0@lo:400:kworker.0 00010000:00080000:3.0:1788483049.722337:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22300 x1875360098679168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483049.722353:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098679168:0@lo:400:kworker.0 00000100:00100000:3.0:1788483049.722365:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098679680:0@lo:400:kworker.0 00000100:00100000:3.0:1788483049.722398:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679552 00000100:00100000:3.0:1788483049.722402:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679552 00000100:00100000:3.0:1788483049.722424:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788483049.722431:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098678656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483049.722467:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098678656:12345-0@lo:400:kworker.0 Request processed in 36us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483049.722474:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788483049.722487:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788483049.722493:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098679552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.722757:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098678272:0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.722800:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483049.722833:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098678784:0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.722858:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483049.722875:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098679296:0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.722908:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483049.722941:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788483049.722948:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098678400:0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.722969:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483049.722981:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098678912:0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.722999:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483049.723010:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098679424:0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.723029:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483049.723051:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679296 00000100:00100000:0.0:1788483049.723055:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679296 00000100:00100000:0.0:1788483049.723085:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788483049.723092:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098679296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.723152:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098679296:12345-0@lo:400:kworker.0 Request processed in 60us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483049.723158:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788483049.723180:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678272 00000100:00100000:0.0:1788483049.723183:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678272 00000100:00100000:0.0:1788483049.723205:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788483049.723211:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098678272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.723240:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098678272:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483049.723256:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788483049.723296:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098678272:0@lo:400:kworker.0 00010000:00080000:0.0:1788483049.723306:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21500 x1875360098679296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483049.723315:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098679296:0@lo:400:kworker.0 00000100:00080000:0.0:1788483049.723343:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483049.723348:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483049.723350:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788483049.723371:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21c00 x1875360098679552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483049.723380:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098679552:0@lo:400:kworker.0 00000100:00100000:0.0:1788483049.723391:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098678656:0@lo:400:kworker.0 00000100:00100000:1.0:1788483049.724188:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678400 00000100:00100000:1.0:1788483049.724195:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678400 00000100:00100000:1.0:1788483049.724224:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678912 00000100:00100000:1.0:1788483049.724227:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678912 00000100:00100000:1.0:1788483049.724254:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679424 00000100:00100000:1.0:1788483049.724257:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679424 00000100:00100000:1.0:1788483049.724274:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788483049.724281:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098678400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483049.724335:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098678400:12345-0@lo:400:kworker.0 Request processed in 55us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483049.724342:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788483049.724357:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788483049.724363:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098678912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483049.724391:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098678912:12345-0@lo:400:kworker.0 Request processed in 29us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483049.724409:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788483049.724420:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788483049.724425:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098679424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483049.724455:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098679424:12345-0@lo:400:kworker.0 Request processed in 30us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483049.724461:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788483049.724485:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098678784 00000100:00100000:1.0:1788483049.724490:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098678784 00000100:00100000:1.0:1788483049.724515:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788483049.724520:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098678784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.724678:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788483049.724687:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098679040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.724734:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098679040:12345-0@lo:400:kworker.0 Request processed in 50us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483049.724740:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788483049.724809:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098678144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483049.724852:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098678400:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.724862:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098678912:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.724871:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098679424:0@lo:400:kworker.0 00000100:00100000:1.0:1788483049.726047:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098678784:12345-0@lo:400:kworker.0 Request processed in 1521us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483049.726056:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788483049.726164:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098679552:12345-0@lo:400:kworker.0 Request processed in 45us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483049.726174:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:0.0:1788483049.726393:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788483049.726430:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20000 x1875360098679040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483049.726444:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098679040:0@lo:400:kworker.0 00000100:00100000:2.0:1788483049.728797:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098678784:0@lo:400:kworker.0 00000100:00100000:0.0:1788483050.244587:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483050.244611:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098679808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483050.244677:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483050.244745:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679808 00000100:00100000:0.0:1788483050.244752:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679808 00000100:00100000:0.0:1788483050.244802:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788483050.244812:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098679808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483050.244848:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483050.244905:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098679808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483050.244921:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788483050.244965:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098679808:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788483050.622214:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788483050.714998:0:14036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:50:48 (1788483048) 00000100:00100000:3.0:1788483051.258024:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483051.258043:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098680064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483051.258044:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098679936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483051.258292:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098680192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483051.265143:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483051.266179:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098679936 00000100:00100000:1.0:1788483051.266191:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098679936 00000100:00100000:1.0:1788483051.266274:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788483051.266285:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098679936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788483051.266320:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483051.266393:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098679936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483051.266400:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:1.0:1788483051.266444:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c6233100 x1875360098679936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483051.266465:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098679936:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788483051.268217:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483051.269185:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483051.269199:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483051.269277:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680064 00000100:00100000:2.0:1788483051.269287:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680064 00000100:00100000:2.0:1788483051.269339:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788483051.269350:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098680064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483051.269380:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788483051.269423:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098680064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483051.269442:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788483051.272501:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680192 00000100:00100000:1.0:1788483051.272516:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680192 00000100:00100000:1.0:1788483051.272619:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788483051.272630:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098680192:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788483051.272636:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788483051.272656:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483051.272934:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098680192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 305us (3751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483051.272941:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1788483051.273341:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cf0000 x1875360098680192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483051.273363:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098680192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483051.294856:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098680064:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788483051.640541:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483052.515549:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483052.515650:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047808 00000100:00100000:3.0:1788483052.515661:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047808 00000100:00100000:3.0:1788483052.515737:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:3.0:1788483052.515748:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:11072:x1875360087047808:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483052.515767:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483052.515789:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1a84e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e230 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.515863:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a855 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.515889:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.515911:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483052.515956:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788483052.515973:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483052.516219:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.516246:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1a84e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e230 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.516265:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e230 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.516274:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56600) 00010000:00010000:3.0:1788483052.516277:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483052.516281:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77200, rc 0) 00000100:00100000:3.0:1788483052.516334:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:11072:x1875360087047808:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 587us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483052.516342:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00080000:2.0:1788483052.517118:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483052.530430:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483052.533040:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087047936 00000100:00100000:2.0:1788483052.533055:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087047936 00000100:00100000:2.0:1788483052.533192:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:2.0:1788483052.533202:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:11073:x1875360087047936:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483052.533224:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483052.533250:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a85c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e237 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533322:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533336:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533347:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533360:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533367:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533373:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533448:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a871 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533456:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533463:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483052.533500:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483052.533504:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483052.533524:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533534:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533541:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533547:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533552:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483052.533556:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533563:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533573:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56600) 00010000:00010000:2.0:1788483052.533581:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483052.533586:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533592:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a863 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533606:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533612:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533617:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533621:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483052.533623:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533629:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533636:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a69df0bff00) 00010000:00010000:2.0:1788483052.533638:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483052.533640:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533645:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a86a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533673:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a85c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e237 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533699:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a871 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e237 expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483052.533706:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69df0bf000) 00010000:00010000:2.0:1788483052.533708:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483052.533710:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1000, rc 0) 00000100:00100000:2.0:1788483052.533794:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11073:x1875360087047936:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 593us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483052.533801:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:0.0:1788483052.537136:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483052.537209:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087048064 00000100:00100000:2.0:1788483052.537218:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087048064 00000100:00100000:2.0:1788483052.537267:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:2.0:1788483052.537277:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11073:x1875360087048064:12345-192.168.206.54@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788483052.538204:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11073:x1875360087048064:12345-192.168.206.54@tcp:900:lhsmtool_posix.0 Request processed in 925us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483052.538214:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:0.0:1788483052.545708:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483052.545801:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087048320 00000100:00100000:3.0:1788483052.545814:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087048320 00000100:00100000:3.0:1788483052.545883:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:3.0:1788483052.545894:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11073:x1875360087048320:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483052.545929:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483052.545954:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1a878 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e23e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.546051:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.546066:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.546139:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.551508:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.551531:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.551545:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.551667:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a88d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.551676:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a88d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.551683:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a88d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483052.551693:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788483052.552031:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552039:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552045:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552051:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483052.552068:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552075:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552087:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69df0bf000) 00010000:00010000:3.0:1788483052.552090:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483052.552094:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552121:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1a87f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552134:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552140:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552145:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552151:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483052.552153:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552159:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552166:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a68c1c56500) 00010000:00010000:3.0:1788483052.552168:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483052.552182:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.552187:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a886 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.553420:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1a878 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e23e expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.553441:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a88d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e23e expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483052.553449:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:3.0:1788483052.553453:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483052.553455:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76c00, rc 0) 00000100:00100000:3.0:1788483052.554582:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:11073:x1875360087048320:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 8684us (8881us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788483052.554592:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:0.0:1788483052.567950:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483052.568145:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087048448 00000100:00100000:3.0:1788483052.568158:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087048448 00000100:00100000:3.0:1788483052.568236:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:3.0:1788483052.568248:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:11073:x1875360087048448:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788483052.568390:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:11073:x1875360087048448:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 144us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483052.568399:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:0.0:1788483052.574663:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483052.574798:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087048576 00000100:00100000:2.0:1788483052.574816:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087048576 00000100:00100000:2.0:1788483052.574934:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:2.0:1788483052.574948:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:11073:x1875360087048576:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788483052.575374:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788483052.576217:0:8434:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1228us 00000100:00100000:1.0:1788483052.630320:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:11073:x1875360087048576:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 55359us (55655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483052.630339:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 44 00010000:00010000:3.0:1788483052.664568:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483052.685517:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483052.685568:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483052.685619:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483052.685691:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087048832 00000100:00100000:2.0:1788483052.685705:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087048832 00000100:00100000:2.0:1788483052.685797:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087048960 00000100:00100000:2.0:1788483052.685815:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087048960 00000100:00100000:2.0:1788483052.685858:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 279 00000100:00100000:2.0:1788483052.685871:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087048832:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483052.685993:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087048832:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 125us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483052.686002:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 279 00000100:00100000:2.0:1788483052.686023:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 280 00000100:00100000:2.0:1788483052.686030:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087048960:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483052.686058:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087048960:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483052.686064:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 280 00000100:00080000:0.0:1788483052.686180:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483052.686185:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483052.686377:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087048704 00000100:00100000:3.0:1788483052.686382:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087048704 00000100:00100000:3.0:1788483052.686441:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 381 00000100:00100000:3.0:1788483052.686450:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087048704:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483052.686497:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d99b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087048704:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 48us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483052.686504:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 381 00000040:00080000:1.0:1788483053.049726:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788483053.112752:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788483053.688230:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483053.816487:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483053.816515:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098680320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483053.816581:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483053.816841:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680320 00000100:00100000:0.0:1788483053.816852:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680320 00000100:00100000:0.0:1788483053.816969:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788483053.816981:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098680320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483053.817029:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788483053.817093:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098680320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483053.817137:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788483053.817223:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098680320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788483054.714782:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483054.721518:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483054.722811:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087049088 00000100:00100000:2.0:1788483054.722823:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087049088 00000100:00100000:2.0:1788483054.722905:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:2.0:1788483054.722916:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:11116:x1875360087049088:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483054.722935:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483054.722958:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a89b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e245 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788483054.723254:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788483054.723311:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723339:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723351:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723366:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723373:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723380:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723421:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723428:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723435:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723441:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483054.723445:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723453:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723464:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56600) 00010000:00010000:2.0:1788483054.723474:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483054.723480:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723487:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a8a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723502:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723508:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723513:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723518:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483054.723521:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723527:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723535:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a69c32fa200) 00010000:00010000:2.0:1788483054.723538:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483054.723541:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723546:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a8a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723578:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a89b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e245 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723601:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56600) 00010000:00010000:2.0:1788483054.723603:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483054.723607:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a89b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e245 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483054.723617:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0200, rc 0) 00000100:00100000:2.0:1788483054.723686:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:11116:x1875360087049088:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 772us (2174us total) trans 0 rc 301/301 00000100:00100000:2.0:1788483054.723694:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:3.0:1788483054.729694:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483054.729920:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087049344 00000100:00100000:0.0:1788483054.729930:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087049344 00000100:00100000:0.0:1788483054.729977:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:0.0:1788483054.729986:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:11116:x1875360087049344:12345-192.168.206.54@tcp:36:lfs.0 00010000:00010000:0.0:1788483054.730040:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483054.730066:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1a855 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e230 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730081:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c56600) 00010000:00010000:0.0:1788483054.730090:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483054.730215:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730228:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730238:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730250:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730258:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730265:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730699:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730708:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730715:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483054.730922:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c00320b1 reply state 000000009322370d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730936:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730943:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483054.730946:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788483054.730949:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788483054.730953:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788483054.730960:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730966:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730972:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730977:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483054.730981:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.730999:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.731007:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183700) 00010000:00010000:0.0:1788483054.731009:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483054.731013:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.731018:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483054.731033:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c00320b1 reply state 000000009322370d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.731042:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.731048:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a68c3183500) 00010000:00010000:0.0:1788483054.731050:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788483054.731052:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788483054.731340:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:11116:x1875360087049344:12345-192.168.206.54@tcp:36:lfs.0 Request processed in 1352us (1653us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788483054.731349:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:1.0:1788483054.841070:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098680576:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.841174:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483054.841200:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098680832:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.841231:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483054.841232:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098681088:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.841255:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483054.841256:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098681344:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.841275:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098681600:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.841279:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483054.841293:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098681856:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.841295:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483054.841315:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788483054.841320:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098680704:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.841329:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483054.841342:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483054.841348:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788483054.841353:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098680448:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.841357:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098681216:0@lo:400:kworker.0 00000100:00100000:2.0:1788483054.841446:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680576 00000100:00100000:2.0:1788483054.841455:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680576 00000100:00100000:3.0:1788483054.841501:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680832 00000100:00100000:2.0:1788483054.841501:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681088 00000100:00100000:2.0:1788483054.841506:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681088 00000100:00100000:3.0:1788483054.841509:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680832 00000100:00100000:3.0:1788483054.841538:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788483054.841539:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681600 00000100:00100000:2.0:1788483054.841544:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681600 00000100:00100000:3.0:1788483054.841550:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098680576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483054.841563:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788483054.841574:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098680832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.847550:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483054.847557:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483054.847685:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098680576:12345-0@lo:400:kworker.0 Request processed in 6135us (6507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.847692:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098680960:0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.847701:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788483054.847732:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681216 00000100:00100000:3.0:1788483054.847739:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681216 00000100:00100000:3.0:1788483054.847774:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788483054.847782:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098681088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.847825:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098681088:12345-0@lo:400:kworker.0 Request processed in 44us (6569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483054.847831:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788483054.847842:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788483054.847848:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098681600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.847875:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098681600:12345-0@lo:400:kworker.0 Request processed in 28us (6579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483054.847901:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788483054.847914:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788483054.847920:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098681216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.847953:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098681216:12345-0@lo:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483054.847959:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788483054.847999:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483054.848004:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483054.848018:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098682112:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788483054.848035:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cf2300 x1875360098681216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483054.848043:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098681472:0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.848058:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483054.848058:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098681216:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.848071:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098681728:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848119:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483054.848122:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098682112 00000100:00100000:3.0:1788483054.848128:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098682112 00000100:00100000:1.0:1788483054.848133:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483054.848147:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098681984:0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.848173:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788483054.848173:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098680576:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848180:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483054.848187:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098682112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483054.848195:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098681088:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.848213:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098681600:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848215:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681728 00000100:00100000:0.0:1788483054.848220:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681728 00002000:00000024:3.0:1788483054.848228:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483054.848257:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788483054.848259:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680704 00000100:00100000:1.0:1788483054.848264:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680704 00000100:00100000:0.0:1788483054.848268:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098681728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.848278:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098682112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483054.848285:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788483054.848300:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680960 00000100:00100000:1.0:1788483054.848304:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680960 00000100:00100000:0.0:1788483054.848318:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098681728:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483054.848327:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788483054.848328:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788483054.848333:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098682112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483054.848342:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098680704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848356:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681344 00000100:00100000:0.0:1788483054.848361:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681344 00000100:00100000:3.0:1788483054.848377:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098680448 00000100:00100000:3.0:1788483054.848384:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098680448 00000100:00100000:0.0:1788483054.848388:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681856 00000100:00100000:1.0:1788483054.848389:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098680704:12345-0@lo:400:kworker.0 Request processed in 49us (7043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.848394:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681856 00000100:00100000:1.0:1788483054.848399:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788483054.848420:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788483054.848420:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681472 00000100:00100000:0.0:1788483054.848425:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681472 00000100:00100000:1.0:1788483054.848432:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098680960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848443:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098681984 00000100:00100000:0.0:1788483054.848447:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098681984 00000100:00100000:0.0:1788483054.848465:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788483054.848471:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098680960:12345-0@lo:400:kworker.0 Request processed in 40us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.848477:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098681344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.848481:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788483054.848500:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483054.848506:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483054.848509:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483054.848519:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483054.848528:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098681344:12345-0@lo:400:kworker.0 Request processed in 54us (7247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.848535:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788483054.848553:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788483054.848562:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098681856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.848594:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098681856:12345-0@lo:400:kworker.0 Request processed in 35us (7265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.848618:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788483054.848627:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098681472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848655:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098681472:12345-0@lo:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.848660:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788483054.848671:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788483054.848677:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098681984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848698:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098681984:12345-0@lo:400:kworker.0 Request processed in 22us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.848703:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788483054.848847:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098680704:0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.848852:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788483054.848863:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098680448:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788483054.848865:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cf3800 x1875360098681728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483054.848877:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098681728:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848918:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098680960:0@lo:400:kworker.0 00010000:00080000:0.0:1788483054.848928:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cf1880 x1875360098681472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483054.848937:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098681472:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848944:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098681984:0@lo:400:kworker.0 00010000:00080000:0.0:1788483054.848953:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cf0e00 x1875360098681344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483054.848970:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098681344:0@lo:400:kworker.0 00000100:00100000:0.0:1788483054.848989:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098681856:0@lo:400:kworker.0 00000100:00100000:3.0:1788483054.848991:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098680448:12345-0@lo:400:kworker.0 Request processed in 128us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483054.849002:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788483054.849014:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098680448:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.849738:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788483054.858908:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098680832:12345-0@lo:400:kworker.0 Request processed in 17328us (17667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483054.858923:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788483054.861340:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098680832:0@lo:400:kworker.0 00000100:00100000:1.0:1788483054.867312:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483054.867488:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087049472 00000100:00100000:0.0:1788483054.867498:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087049472 00000100:00100000:0.0:1788483054.867616:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:0.0:1788483054.867626:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:11124:x1875360087049472:12345-192.168.206.54@tcp:101:lctl.0 00010000:00010000:0.0:1788483054.867648:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483054.867669:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e24c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.867791:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a8cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.867806:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.867819:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483054.867857:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788483054.867861:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483054.867907:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.867932:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e24c expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.867962:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a8cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e24c expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.867972:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:0.0:1788483054.867975:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483054.867978:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9800, rc 0) 00000100:00100000:0.0:1788483054.868037:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:11124:x1875360087049472:12345-192.168.206.54@tcp:101:lctl.0 Request processed in 412us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.868044:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:2.0:1788483054.940442:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483054.940561:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087049600 00000100:00100000:0.0:1788483054.940571:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087049600 00000100:00100000:0.0:1788483054.940658:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 48 00000100:00100000:0.0:1788483054.940669:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:11130:x1875360087049600:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483054.940687:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483054.940706:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e253 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940766:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940779:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940790:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940801:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940821:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940827:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940919:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a8e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940928:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.940935:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483054.940966:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788483054.940970:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483054.941018:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941030:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941037:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941043:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941058:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483054.941062:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941502:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941515:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:0.0:1788483054.941517:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483054.941521:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941527:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a8da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941540:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941546:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941551:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941556:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483054.941559:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941564:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941572:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a68c3183500) 00010000:00010000:0.0:1788483054.941574:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483054.941577:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941593:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a8e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941620:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a8d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e253 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941633:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e253 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.941639:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483054.941641:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788483054.941644:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9400, rc 0) 00000100:00100000:0.0:1788483054.941694:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:11130:x1875360087049600:12345-192.168.206.54@tcp:101:bash.0 Request processed in 1028us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.941701:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 48 00000100:00100000:3.0:1788483054.945578:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483054.945664:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087049856 00000100:00100000:1.0:1788483054.945674:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087049856 00000100:00100000:1.0:1788483054.945740:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00100000:1.0:1788483054.945750:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:11130:x1875360087049856:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:1.0:1788483054.945768:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483054.945789:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1a8ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e25a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.945914:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.945930:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.945942:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.945957:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.945964:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.945987:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483054.946346:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788483054.946491:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946502:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946510:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946545:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946551:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946558:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946564:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483054.946568:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946575:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946588:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:1.0:1788483054.946590:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483054.946603:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946609:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1a8f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483054.946622:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f13bfc84 reply state 00000000502a89c0 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946632:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946639:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:1.0:1788483054.946641:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788483054.946644:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788483054.946675:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1a8ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946689:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.946695:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2f00) 00010000:00010000:1.0:1788483054.946698:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483054.946700:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27400, rc 0) 00000100:00100000:1.0:1788483054.946764:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11130:x1875360087049856:12345-192.168.206.54@tcp:101:bash.0 Request processed in 1015us (1194us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788483054.946771:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00100000:1.0:1788483054.954957:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483054.955122:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087049984 00000100:00100000:2.0:1788483054.955133:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087049984 00000100:00100000:2.0:1788483054.955182:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:2.0:1788483054.955190:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875360087049984:12345-192.168.206.54@tcp:8:bash.0 00010000:00080000:2.0:1788483054.955221:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:2.0:1788483054.955263:0:8411:0:(genops.c:1385:class_connect()) connect: client d93ec387-f41f-455a-afdd-b6a72a2f59de, cookie 0x1d7ea3d89ea1a912 00002000:00100000:2.0:1788483054.955276:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d93ec387-f41f-455a-afdd-b6a72a2f59de/ffff9a69c787a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788483054.955298:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788483054.955369:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788483054.955399:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9a69c7878800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483054.955462:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2389:x1875360087049984:12345-192.168.206.54@tcp:8:bash.0 Request processed in 271us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483054.955482:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:3.0:1788483054.958897:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483054.958984:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087050112 00000100:00100000:0.0:1788483054.958992:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087050112 00000100:00100000:0.0:1788483054.959090:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:0.0:1788483054.959130:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:0:x1875360087050112:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483054.959146:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483054.959167:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e261 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483054.959191:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483054.959208:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1788483054.959213:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483054.959249:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.959272:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.959291:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9e00, rc 0) 00000100:00100000:0.0:1788483054.959338:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:0:x1875360087050112:12345-192.168.206.54@tcp:101:bash.0 Request processed in 211us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.959345:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00080000:1.0:1788483054.959991:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483054.964869:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483054.964956:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087050240 00000100:00100000:0.0:1788483054.964965:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087050240 00000100:00100000:0.0:1788483054.965023:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:0.0:1788483054.965033:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11130:x1875360087050240:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483054.965062:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483054.965084:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e268 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.965160:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.965169:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483054.965173:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483054.965179:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.965211:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.965238:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 8 pid: 8409 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483054.965252:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1875360098682240:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483054.965342:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c35f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483054.971162:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483054.971188:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1875360098682240:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483054.971222:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.971242:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9600, rc 0) 00000100:00100000:0.0:1788483054.971307:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:11130:x1875360087050240:12345-192.168.206.54@tcp:101:bash.0 Request processed in 6274us (6458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483054.971316:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:1.0:1788483054.971409:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087050368 00000100:00100000:1.0:1788483054.971433:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087050368 00010000:00010000:1.0:1788483054.971465:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 8 pid: 8409 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483054.971503:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:1.0:1788483054.971513:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087050368:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483054.971527:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483054.971547:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 8 pid: 8409 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.971558:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 8 pid: 8409 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.971580:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5105b28/0x1d7ea3d89ea1a919 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e261 expref: 8 pid: 8409 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.971593:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483054.971597:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483054.971604:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.971614:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483054.971644:0:7436:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483054.971669:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7436:1875360098682368:192.168.206.54@tcp:105: 00000100:00100000:1.0:1788483054.971742:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c342c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788483054.982850:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483054.983006:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7436:1875360098682368:192.168.206.54@tcp:105: 00010000:00010000:1.0:1788483054.983032:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483054.983140:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087050368:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 11628us (11985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483054.983152:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:2.0:1788483054.983517:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087050624 00000100:00100000:2.0:1788483054.983524:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087050624 00000100:00100000:3.0:1788483054.983636:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:3.0:1788483054.983647:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11130:x1875360087050624:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:3.0:1788483054.984791:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:11130:x1875360087050624:12345-192.168.206.54@tcp:35:bash.0 Request processed in 1140us (1945us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788483054.984801:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:3.0:1788483055.083408:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483055.086655:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087050880 00000100:00100000:2.0:1788483055.086670:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087050880 00000100:00100000:2.0:1788483055.086735:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:2.0:1788483055.086745:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:11140:x1875360087050880:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483055.086766:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483055.086788:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e26f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483055.086896:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788483055.087001:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a927 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e26f expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.087016:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:2.0:1788483055.087019:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483055.087024:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1a927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e26f expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.087057:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1a00, rc 0) 00000100:00100000:2.0:1788483055.087189:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:11140:x1875360087050880:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 444us (3789us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788483055.087196:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:2.0:1788483055.096534:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.096876:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087051136 00000100:00100000:1.0:1788483055.096895:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087051136 00000100:00100000:1.0:1788483055.096951:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483055.096960:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:11140:x1875360087051136:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:1.0:1788483055.097217:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:11140:x1875360087051136:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 257us (690us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788483055.097225:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483055.231171:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483055.231265:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087051264 00000100:00100000:0.0:1788483055.231275:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087051264 00000100:00100000:0.0:1788483055.231332:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:0.0:1788483055.231342:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:11146:x1875360087051264:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483055.231363:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483055.231384:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e276 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.231462:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a93c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.231498:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a93c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.231509:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a93c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483055.231549:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788483055.231554:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483055.231570:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a93c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.231595:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e276 expref: 20 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.231614:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a93c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e276 expref: 19 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.231622:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483055.231625:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483055.231629:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8000, rc 0) 00000100:00100000:0.0:1788483055.231690:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11146:x1875360087051264:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 350us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483055.231698:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:3.0:1788483055.242833:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483055.242960:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087051520 00000100:00100000:2.0:1788483055.242973:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087051520 00000100:00100000:2.0:1788483055.243049:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:2.0:1788483055.243063:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11146:x1875360087051520:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483055.243083:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483055.243141:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a943 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e27d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.243670:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a94a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.243690:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.243701:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483055.243713:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788483055.243904:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e27d expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.243992:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e27d expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.244085:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2f00) 00010000:00010000:2.0:1788483055.244088:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483055.244092:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1c00, rc 0) 00000100:00100000:2.0:1788483055.244543:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:11146:x1875360087051520:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1483us (1720us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788483055.244553:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:2.0:1788483055.249306:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483055.249398:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483055.249508:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087051904 00000100:00100000:0.0:1788483055.249517:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087051904 00000100:00100000:0.0:1788483055.249578:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:0.0:1788483055.249587:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:11146:x1875360087051904:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483055.249612:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483055.249644:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a958 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e284 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.249754:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a95f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.249768:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a95f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.249779:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a95f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483055.249792:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788483055.249907:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a958 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e284 expref: 24 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.249925:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a95f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e284 expref: 23 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.249934:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2f00) 00010000:00010000:0.0:1788483055.249937:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788483055.249940:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9a00, rc 0) 00000100:00100000:0.0:1788483055.250233:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:11146:x1875360087051904:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 646us (833us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788483055.250240:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:1.0:1788483055.250557:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087051648 00000100:00100000:1.0:1788483055.250564:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087051648 00000100:00100000:1.0:1788483055.250612:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:1.0:1788483055.250621:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:2393:x1875360087051648:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483055.250631:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483055.250647:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a94a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e27d expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.250660:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2f00) 00010000:00010000:1.0:1788483055.250672:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483055.250706:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:2393:x1875360087051648:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 87us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483055.250713:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:1.0:1788483055.276364:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483055.276480:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087052032 00000100:00100000:0.0:1788483055.276490:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087052032 00000100:00100000:0.0:1788483055.276548:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:0.0:1788483055.276559:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087052032:12345-192.168.206.54@tcp:1:lfs.0 00010000:00010000:0.0:1788483055.276613:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.276633:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.276641:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483055.276646:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483055.276650:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.276682:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.276695:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 7 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483055.276708:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875360098682496:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483055.276837:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c56389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483055.286078:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875360098682496:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483055.286151:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483055.296003:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483055.296148:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087052160 00000100:00100000:0.0:1788483055.296159:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087052160 00002000:00100000:0.0:1788483055.296205:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9a69c541a680 x1875360087052160/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:561/0 lens 504/0 e 0 to 0 dl 1788483066 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788483055.296227:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69c541a680 with x1875360087052160 ext(0->12) 00010000:00010000:0.0:1788483055.296237:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 8 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.296252:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 8 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483055.296259:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69c541a680 00000100:00100000:0.0:1788483055.296281:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:0.0:1788483055.296289:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087052160:12345-192.168.206.54@tcp:4:lfs.0 00000001:00100000:3.0:1788483055.299408:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000100:00100000:0.0:1788483055.300139:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087052160:12345-192.168.206.54@tcp:4:lfs.0 Request processed in 3839us (4132us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788483055.300150:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00002000:00100000:0.0:1788483055.300163:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9a69c541a680 x1875360087052160/t4294967300(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:561/0 lens 504/448 e 0 to 0 dl 1788483066 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788483055.300173:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69c541a680 with x1875360087052160 ext(0->12) 00010000:00010000:0.0:1788483055.300184:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.300201:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483055.300208:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69c541a680 00000100:00100000:2.0:1788483055.311266:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483055.311331:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087052288 00000100:00100000:3.0:1788483055.311345:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087052288 00010000:00010000:3.0:1788483055.311387:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483055.311679:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:2.0:1788483055.311690:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2390:x1875360087052288:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483055.311705:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788483055.311723:0:6480:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788483055.311727:0:6480:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788483054 00002000:00010000:2.0:1788483055.311729:0:6480:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788483054 00002000:00010000:2.0:1788483055.311731:0:6480:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788483054 00002000:00010000:2.0:1788483055.311733:0:6480:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788483055.311739:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.311754:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.311778:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016feb8e6/0x1d7ea3d89ea1a920 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e268 expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.311813:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483055.311818:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483055.311823:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.311833:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.311864:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483055.311928:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2390:x1875360087052288:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 239us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483055.311935:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00010000:00010000:0.0:1788483055.312398:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312487:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312508:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312517:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312525:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312532:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483055.312537:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312546:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312627:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.312636:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1a96d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483055.312699:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087052032:12345-192.168.206.54@tcp:1:lfs.0 Request processed in 36141us (36342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483055.312708:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:2.0:1788483055.324466:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483055.324554:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087052544 00000100:00100000:0.0:1788483055.324563:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087052544 00000100:00100000:0.0:1788483055.324620:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:0.0:1788483055.324630:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11146:x1875360087052544:12345-192.168.206.54@tcp:35:lfs.0 00000004:00010000:0.0:1788483055.324688:0:6496:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a95f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e284 expref: 22 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483055.324945:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788483055.325000:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788483055.325310:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788483055.325347:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.325362:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.325371:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.325403:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.325416:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 26 pid: 6494 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483055.325445:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875360098682624:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483055.325519:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483055.328076:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875360098682624:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483055.328164:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483055.328553:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.328795:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087052672 00000100:00100000:1.0:1788483055.328804:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087052672 00010000:00010000:1.0:1788483055.328846:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 27 pid: 6494 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483055.328904:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:1.0:1788483055.328915:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:2392:x1875360087052672:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483055.328928:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483055.328934:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 27 pid: 6494 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.328947:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 27 pid: 6494 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.328966:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1a904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e25a expref: 27 pid: 6494 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.329081:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2f00) 00010000:00010000:1.0:1788483055.329086:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.329302:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.329324:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.329349:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483055.329397:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+26:2392:x1875360087052672:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 484us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483055.329404:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00010000:00010000:0.0:1788483055.329467:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.329476:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483055.329583:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788483055.329706:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788483055.329795:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098682752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788483055.329845:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483055.329877:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483055.330475:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098682752 00000100:00100000:1.0:1788483055.330483:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098682752 00000100:00100000:1.0:1788483055.330516:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788483055.330525:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098682752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788483055.330615:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098682752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483055.330622:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788483055.330706:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098682752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788483055.330866:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788483055.330928:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098682880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788483055.330963:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483055.330998:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483055.331141:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098682880 00000100:00100000:0.0:1788483055.331147:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098682880 00000100:00100000:0.0:1788483055.331183:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788483055.331191:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098682880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788483055.331298:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6496:x1875360098682880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (334us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788483055.331305:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788483055.331596:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098682880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788483055.331642:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788483055.331675:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.331686:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.331709:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.331715:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483055.331719:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.331727:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.331742:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2f00) 00010000:00010000:2.0:1788483055.331744:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788483055.331748:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.331755:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1a974 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788483055.331845:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788483055.331917:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788483055.331929:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347594831706ns, next at 348594829587ns, rc = 0 00000001:00080000:2.0:1788483055.331936:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788483055.331957:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2f00) 00010000:00010000:2.0:1788483055.331960:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788483055.331967:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1a95f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e284 expref: 30 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483055.333352:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:11146:x1875360087052544:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 8717us (8889us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788483055.333379:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000020:00080000:2.0:1788483055.333385:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788483055.336163:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.336229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087052800 00000100:00100000:1.0:1788483055.336239:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087052800 00000100:00100000:1.0:1788483055.336304:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:1.0:1788483055.336315:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:11146:x1875360087052800:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:1.0:1788483055.336339:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483055.336362:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1a97b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e28b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.336417:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1a97b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e28b expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.336431:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1a97b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e28b expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.336468:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:1.0:1788483055.336472:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483055.336475:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26600, rc 0) 00000100:00100000:1.0:1788483055.336531:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:11146:x1875360087052800:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 219us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483055.336538:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:2.0:1788483055.352383:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483055.354807:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.355026:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087053056 00000100:00100000:1.0:1788483055.355036:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087053056 00000100:00100000:1.0:1788483055.355122:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:1.0:1788483055.355132:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4626050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:11146:x1875360087053056:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:1.0:1788483055.355364:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4626050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+31:11146:x1875360087053056:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 233us (564us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788483055.355372:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:2.0:1788483055.359781:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098683008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483055.359942:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483055.360144:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098683008 00000100:00100000:1.0:1788483055.360153:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098683008 00000100:00100000:1.0:1788483055.360213:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788483055.360223:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098683008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483055.360246:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483055.360293:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098683008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483055.360300:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788483055.360432:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098683008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483055.479422:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.481958:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087053312 00000100:00100000:1.0:1788483055.481972:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087053312 00000100:00100000:0.0:1788483055.483438:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:0.0:1788483055.483456:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+31:11156:x1875360087053312:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483055.483483:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483055.483507:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e292 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483055.483627:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788483055.483722:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a982 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e292 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.483736:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:0.0:1788483055.483739:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483055.483744:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1a982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e292 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483055.483757:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8c00, rc 0) 00000100:00100000:0.0:1788483055.485694:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11156:x1875360087053312:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 2233us (6271us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788483055.485707:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:3.0:1788483055.491322:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483055.491478:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087053440 00000100:00100000:2.0:1788483055.491491:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087053440 00000100:00100000:2.0:1788483055.491558:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:2.0:1788483055.491571:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11156:x1875360087053440:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:2.0:1788483055.491652:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491670:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491683:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491695:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491703:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491709:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491786:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491809:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491816:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483055.491865:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491879:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491895:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491901:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491907:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483055.491912:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491920:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491932:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483055.491935:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483055.491939:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491945:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a990 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491967:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491973:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491979:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491985:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483055.491988:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.491993:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492001:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:2.0:1788483055.492003:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483055.492006:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492011:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a997 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492020:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492025:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492030:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492040:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483055.492043:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492048:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492057:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483055.492059:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483055.492062:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.492067:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a99e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483055.492170:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11156:x1875360087053440:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 600us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483055.492178:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:3.0:1788483055.498342:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.498435:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087053696 00000100:00100000:1.0:1788483055.498444:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087053696 00000100:00100000:1.0:1788483055.498517:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:1.0:1788483055.498528:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11156:x1875360087053696:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:1.0:1788483055.498741:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:11156:x1875360087053696:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 215us (409us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788483055.498749:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:3.0:1788483055.560504:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483055.561225:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087053952 00000100:00100000:2.0:1788483055.561235:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087053952 00000100:00100000:2.0:1788483055.561321:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:2.0:1788483055.561332:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:11159:x1875360087053952:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483055.561357:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483055.561380:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a9a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e299 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561453:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561484:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561494:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561505:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561511:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561517:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561643:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561652:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561660:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483055.561670:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788483055.561742:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561751:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561758:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561769:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483055.561774:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561781:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561794:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483055.561797:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483055.561801:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561806:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1a9ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561821:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561826:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561831:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561836:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483055.561838:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561845:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561876:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:2.0:1788483055.561879:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483055.561891:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561898:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561936:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a9a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 36 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561949:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 35 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.561955:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483055.561957:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483055.561959:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1e00, rc 0) 00000100:00100000:2.0:1788483055.562036:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:11159:x1875360087053952:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 705us (1541us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788483055.562043:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:0.0:1788483055.568274:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483055.568480:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087054080 00000100:00100000:3.0:1788483055.568491:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087054080 00000100:00100000:3.0:1788483055.568556:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:3.0:1788483055.568568:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:11159:x1875360087054080:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:3.0:1788483055.568654:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568688:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568700:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568741:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568747:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568753:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568758:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483055.568762:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568769:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568780:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483055.568782:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483055.568787:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483055.568793:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1a9c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483055.568879:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:11159:x1875360087054080:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 313us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483055.568905:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:3.0:1788483055.580048:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.580139:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087054336 00000100:00100000:1.0:1788483055.580148:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087054336 00000100:00100000:1.0:1788483055.580199:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:1.0:1788483055.580209:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:11159:x1875360087054336:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:1.0:1788483055.580444:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:11159:x1875360087054336:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 236us (405us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788483055.580453:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00010000:00010000:3.0:1788483055.736436:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483055.962029:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483055.963198:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087054592 00000100:00100000:2.0:1788483055.963211:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087054592 00000100:00100000:2.0:1788483055.963274:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:2.0:1788483055.963284:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:11190:x1875360087054592:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:2.0:1788483055.963307:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483055.963327:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a9cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2a0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.963456:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.963646:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.963660:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483055.963673:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788483055.963868:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a9cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a0 expref: 39 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.963896:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a0 expref: 38 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483055.963906:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483055.963909:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483055.963913:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1400, rc 0) 00000100:00100000:2.0:1788483055.963982:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:11190:x1875360087054592:12345-192.168.206.54@tcp:101:cat.0 Request processed in 699us (1961us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788483055.963989:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:0.0:1788483055.967687:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483055.967789:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483055.967933:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087054720 00000100:00100000:1.0:1788483055.967942:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087054720 00000100:00100000:1.0:1788483055.968005:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:1.0:1788483055.968014:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:2390:x1875360087054720:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483055.968028:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483055.968051:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1a9d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a0 expref: 38 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483055.968082:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:1.0:1788483055.968087:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483055.968199:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087054976 00000100:00100000:3.0:1788483055.968204:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087054976 00000100:00100000:3.0:1788483055.968232:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788483055.968238:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:11190:x1875360087054976:12345-192.168.206.54@tcp:35:cat.0 00000100:00100000:1.0:1788483055.968399:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:2390:x1875360087054720:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 156us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483055.968410:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:3.0:1788483055.968420:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:11190:x1875360087054976:12345-192.168.206.54@tcp:35:cat.0 Request processed in 180us (630us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1788483055.968432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788483056.073590:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483056.073679:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087055232 00000100:00100000:0.0:1788483056.073689:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087055232 00000100:00100000:0.0:1788483056.073779:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:0.0:1788483056.073791:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:11196:x1875360087055232:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:0.0:1788483056.073817:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483056.073831:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788483056.073856:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1a93c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e276 expref: 38 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.073875:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483056.073890:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483056.073902:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a9e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.074003:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.074017:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 38 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.074025:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.074056:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 38 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.074069:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 38 pid: 8434 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483056.074082:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098683136:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483056.074597:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1788483056.074756:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483056.078877:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098683136:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483056.078916:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483056.079565:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483056.079836:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087055360 00000100:00100000:0.0:1788483056.079844:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087055360 00010000:00010000:0.0:1788483056.079900:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 39 pid: 8434 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483056.079955:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:0.0:1788483056.079965:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:2392:x1875360087055360:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483056.079980:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483056.079987:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 39 pid: 8434 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.080000:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 39 pid: 8434 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.080022:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1a9ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e299 expref: 39 pid: 8434 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.080038:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:0.0:1788483056.080043:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.080053:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.080061:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483056.080083:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483056.080183:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:2392:x1875360087055360:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 205us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483056.080192:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 55 00010000:00010000:3.0:1788483056.081025:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.081037:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483056.081056:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788483056.081245:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1a9e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.081263:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.081280:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483056.081283:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788483056.081287:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9e00, rc 0) 00000100:00100000:3.0:1788483056.081337:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:11196:x1875360087055232:12345-192.168.206.54@tcp:101:dd.0 Request processed in 7549us (7756us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788483056.081344:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:3.0:1788483056.090486:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483056.090588:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087055488 00000100:00100000:2.0:1788483056.090599:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087055488 00000100:00100000:2.0:1788483056.090658:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:2.0:1788483056.090668:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:11196:x1875360087055488:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:2.0:1788483056.090692:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483056.090724:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a9f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2ae expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.090770:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.090784:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.090795:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.090917:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1a9f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 40 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.090936:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 39 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.090945:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483056.090948:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483056.090952:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0200, rc 0) 00000100:00100000:2.0:1788483056.091010:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:11196:x1875360087055488:12345-192.168.206.54@tcp:101:dd.0 Request processed in 342us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483056.091017:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:0.0:1788483056.106781:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483056.106933:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087055744 00000100:00100000:3.0:1788483056.106944:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087055744 00000100:00100000:3.0:1788483056.107005:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:3.0:1788483056.107015:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:11196:x1875360087055744:12345-192.168.206.54@tcp:36:dd.0 00010000:00010000:3.0:1788483056.107272:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.107289:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.107300:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483056.107342:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788483056.107361:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003be9fa18 reply state 0000000015fc6811 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.107373:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.107379:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483056.107388:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483056.107392:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483056.107473:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:11196:x1875360087055744:12345-192.168.206.54@tcp:36:dd.0 Request processed in 459us (700us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788483056.107480:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 62 00000020:00080000:3.0:1788483056.107484:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788483056.120750:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788483056.187356:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:3.0:1788483056.376320:0:8549:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348639220241ns, next at 349639217281ns, rc = 0 00000100:00100000:1.0:1788483056.376393:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483056.376416:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098683264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483056.376496:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483056.376609:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098683264 00000100:00100000:3.0:1788483056.376616:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098683264 00000100:00100000:3.0:1788483056.376685:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788483056.376696:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098683264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483056.376716:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788483056.376833:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483056.376922:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098683264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483056.376929:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788483056.377008:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098683264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483056.377400:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098683392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483056.377433:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483056.377523:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098683392 00000100:00100000:1.0:1788483056.377529:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098683392 00000100:00100000:1.0:1788483056.377569:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788483056.377577:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098683392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483056.377602:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483056.377647:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098683392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483056.377654:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788483056.377960:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098683392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483056.379034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098683520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483056.379087:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483056.380360:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098683520 00000100:00100000:1.0:1788483056.380371:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098683520 00000100:00100000:1.0:1788483056.380498:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788483056.380509:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098683520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788483056.380540:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483056.380598:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098683520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483056.380606:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788483056.380670:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483056.380708:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098683520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483056.536131:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483056.536327:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087055872 00000100:00100000:3.0:1788483056.536337:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087055872 00000100:00100000:3.0:1788483056.536392:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:3.0:1788483056.536402:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:11210:x1875360087055872:12345-192.168.206.54@tcp:101:stat.0 00010000:00010000:3.0:1788483056.536424:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483056.536443:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aa0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2b5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536506:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536530:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536541:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536553:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536560:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536567:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536638:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536648:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536657:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536687:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.536702:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 43 pid: 6495 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483056.536729:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098683648:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483056.536819:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483056.538513:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098683648:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483056.538542:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483056.542427:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483056.543123:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087056128 00000100:00100000:2.0:1788483056.543145:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087056128 00000100:00100000:2.0:1788483056.543243:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:2.0:1788483056.543255:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:6163:x1875360087056128:12345-192.168.206.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788483056.543535:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+45:6163:x1875360087056128:12345-192.168.206.54@tcp:35:ldlm_bl.0 Request processed in 282us (1115us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788483056.543543:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:1.0:1788483056.547267:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483056.547417:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087056256 00000100:00100000:2.0:1788483056.547425:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087056256 00010000:00010000:2.0:1788483056.547465:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 45 pid: 6495 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483056.547504:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:2.0:1788483056.547524:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+45:2393:x1875360087056256:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483056.547539:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483056.547546:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 45 pid: 6495 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.547559:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 45 pid: 6495 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.547581:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1a9eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2a7 expref: 45 pid: 6495 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.547598:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483056.547603:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.547630:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.547803:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483056.547837:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483056.547904:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:2393:x1875360087056256:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 390us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483056.547913:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 56 00010000:00010000:3.0:1788483056.549048:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549062:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483056.549244:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788483056.549249:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483056.549288:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549301:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549310:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549316:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549323:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549328:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483056.549342:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549349:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549363:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:3.0:1788483056.549366:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483056.549370:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549377:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aa15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549391:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549398:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549403:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549409:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483056.549412:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549418:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549426:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:3.0:1788483056.549428:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483056.549437:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549443:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549478:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aa0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2b5 expref: 44 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549491:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2b5 expref: 43 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.549499:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483056.549501:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483056.549503:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:3.0:1788483056.549615:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:11210:x1875360087055872:12345-192.168.206.54@tcp:101:stat.0 Request processed in 13212us (13490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483056.549623:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:1.0:1788483056.628403:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483056.629198:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087056512 00000100:00100000:3.0:1788483056.629207:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087056512 00000100:00100000:3.0:1788483056.629265:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:3.0:1788483056.629274:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:11216:x1875360087056512:12345-192.168.206.54@tcp:36:truncate.0 00010000:00010000:3.0:1788483056.629322:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483056.629346:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2b5 expref: 43 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.629366:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483056.629370:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483056.629533:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.629546:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.629555:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483056.629591:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788483056.629607:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c29a702 reply state 000000008f20127d transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.629619:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.629625:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483056.629627:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483056.629630:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483056.629737:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+45:11216:x1875360087056512:12345-192.168.206.54@tcp:36:truncate.0 Request processed in 463us (1341us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788483056.629745:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00000020:00080000:3.0:1788483056.629749:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788483056.760281:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483056.834377:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483056.834505:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087056640 00000100:00100000:1.0:1788483056.834519:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087056640 00000100:00100000:1.0:1788483056.834595:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:1.0:1788483056.834607:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+45:11230:x1875360087056640:12345-192.168.206.54@tcp:101:stat.0 00010000:00010000:1.0:1788483056.834639:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483056.834664:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1aa31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2bc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.834749:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.834766:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.834793:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.834808:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.834816:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.834822:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835000:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835011:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835039:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483056.835089:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788483056.835141:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483056.835169:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835185:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835193:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835199:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835206:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835213:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483056.835218:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835227:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835242:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:1.0:1788483056.835245:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483056.835251:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835269:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1aa38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835285:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835292:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835298:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835304:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483056.835307:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835313:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835321:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:1.0:1788483056.835323:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483056.835326:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835332:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1aa3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835365:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1aa31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 47 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835379:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 46 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483056.835393:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:1.0:1788483056.835395:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483056.835398:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27e00, rc 0) 00000100:00100000:1.0:1788483056.835497:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+46:11230:x1875360087056640:12345-192.168.206.54@tcp:101:stat.0 Request processed in 891us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483056.835505:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:0.0:1788483056.955804:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483056.956366:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087056896 00000100:00100000:3.0:1788483056.956448:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087056896 00000100:00100000:3.0:1788483056.956622:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:3.0:1788483056.956633:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+46:11240:x1875360087056896:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483056.956653:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483056.956672:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2c3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483056.956798:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788483056.956918:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa4d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2c3 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.956932:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:3.0:1788483056.956935:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483056.956940:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2c3 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483056.957084:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:3.0:1788483056.957191:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+47:11240:x1875360087056896:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 559us (1396us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1788483056.957199:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:2.0:1788483056.967636:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483056.970675:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087057152 00000100:00100000:3.0:1788483056.970688:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087057152 00000100:00100000:3.0:1788483056.970750:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:3.0:1788483056.970773:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+47:11240:x1875360087057152:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483056.971007:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+48:11240:x1875360087057152:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 236us (3379us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788483056.971015:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:1.0:1788483057.076442:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483057.076533:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087057408 00000100:00100000:2.0:1788483057.076544:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087057408 00000100:00100000:2.0:1788483057.076609:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:2.0:1788483057.076620:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+48:11247:x1875360087057408:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483057.076643:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483057.076663:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2ca expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.076776:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.076791:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 49 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.076799:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.076829:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 49 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.076853:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 49 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483057.076866:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098683776:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483057.076972:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483057.089010:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483057.089152:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098683776:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483057.089182:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483057.089436:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087057536 00000100:00100000:1.0:1788483057.089443:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087057536 00010000:00010000:1.0:1788483057.089480:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 50 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483057.089526:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:1.0:1788483057.089541:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+50:2392:x1875360087057536:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483057.089558:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483057.089565:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 50 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.089585:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 50 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.089610:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1aa46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2bc expref: 50 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.089627:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:1.0:1788483057.089651:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.089661:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.089671:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.089857:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483057.089932:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+49:2392:x1875360087057536:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 393us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483057.089945:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 57 00010000:00010000:2.0:1788483057.096336:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.096353:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483057.096378:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788483057.096520:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 50 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.096540:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 49 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.096549:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483057.096551:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483057.096555:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1c00, rc 0) 00000100:00100000:2.0:1788483057.096672:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+49:11247:x1875360087057408:12345-192.168.206.54@tcp:101:bash.0 Request processed in 20053us (20239us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788483057.096696:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:0.0:1788483057.116215:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.116478:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087057792 00000100:00100000:3.0:1788483057.116489:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087057792 00000100:00100000:3.0:1788483057.116546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:3.0:1788483057.116556:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+49:11247:x1875360087057792:12345-192.168.206.54@tcp:36:bash.0 00010000:00010000:3.0:1788483057.117010:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.117041:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.117052:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483057.118307:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788483057.118365:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076576ff5 reply state 000000009543ea89 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.118386:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.118395:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.118398:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483057.118402:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483057.119907:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+52:11247:x1875360087057792:12345-192.168.206.54@tcp:36:bash.0 Request processed in 3344us (3695us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788483057.119918:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 68 00000020:00080000:3.0:1788483057.119924:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788483057.137030:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.137128:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087057920 00000100:00100000:3.0:1788483057.137138:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087057920 00000100:00100000:3.0:1788483057.137198:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:3.0:1788483057.137208:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+52:11247:x1875360087057920:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:3.0:1788483057.137240:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483057.137263:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aa77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2d1 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.137389:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.137412:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.137420:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.137453:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.137475:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 53 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483057.137488:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098683904:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483057.137619:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483057.151182:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098683904:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483057.151211:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483057.151811:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483057.151917:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087058048 00000100:00100000:1.0:1788483057.151924:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087058048 00010000:00010000:1.0:1788483057.151972:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 54 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483057.152025:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:1.0:1788483057.152034:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:2392:x1875360087058048:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483057.152048:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483057.152054:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 54 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.152065:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 54 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.152084:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1aa62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ca expref: 54 pid: 6493 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.152140:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:1.0:1788483057.152144:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.152153:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.152160:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.152183:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483057.152225:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+53:2392:x1875360087058048:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 192us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483057.152244:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 58 00010000:00010000:3.0:1788483057.153695:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.153708:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483057.153759:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788483057.153763:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483057.153781:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.153831:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aa77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2d1 expref: 53 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.155311:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2d1 expref: 52 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.155329:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.155332:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483057.155336:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77200, rc 0) 00000100:00100000:3.0:1788483057.155522:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+52:11247:x1875360087057920:12345-192.168.206.54@tcp:101:bash.0 Request processed in 18312us (18499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483057.155531:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:0.0:1788483057.161630:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.161787:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087058304 00000100:00100000:3.0:1788483057.161798:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087058304 00000100:00100000:3.0:1788483057.161863:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:3.0:1788483057.161884:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4627450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+52:11247:x1875360087058304:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:3.0:1788483057.162472:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4627450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+53:11247:x1875360087058304:12345-192.168.206.54@tcp:35:bash.0 Request processed in 596us (849us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788483057.162481:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:0.0:1788483057.295571:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.295757:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087058560 00000100:00100000:3.0:1788483057.295767:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087058560 00000100:00100000:3.0:1788483057.295830:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:3.0:1788483057.295840:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+53:11257:x1875360087058560:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483057.295862:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483057.295894:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aa85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483057.296359:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788483057.297282:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aa85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2d8 expref: 55 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.297299:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:3.0:1788483057.297302:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483057.297307:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aa85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2d8 expref: 55 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.297323:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76000, rc 0) 00000100:00100000:3.0:1788483057.297793:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11257:x1875360087058560:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1951us (2227us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788483057.297802:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:0.0:1788483057.324782:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483057.324851:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087058688 00000100:00100000:2.0:1788483057.324861:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087058688 00000100:00100000:2.0:1788483057.324936:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:2.0:1788483057.324946:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11257:x1875360087058688:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:2.0:1788483057.325039:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.325055:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.325067:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.325078:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.325085:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.325091:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326232:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326250:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326259:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483057.326328:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326342:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326349:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326356:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326750:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483057.326756:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326765:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326778:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483057.326781:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483057.326785:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326791:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1aa93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326806:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326812:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326825:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326830:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483057.326833:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326839:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326848:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:2.0:1788483057.326850:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483057.326852:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326858:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1aa9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326867:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326882:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326888:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326893:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483057.326895:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326911:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326920:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483057.326922:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483057.326925:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.326931:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1aaa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483057.327725:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11257:x1875360087058688:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 2246us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483057.327739:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:0.0:1788483057.342068:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483057.342223:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087058944 00000100:00100000:2.0:1788483057.342234:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087058944 00000100:00100000:2.0:1788483057.342303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:2.0:1788483057.342312:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11257:x1875360087058944:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483057.342518:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+55:11257:x1875360087058944:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 207us (460us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788483057.342526:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:0.0:1788483057.402820:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.403029:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087059200 00000100:00100000:3.0:1788483057.403039:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087059200 00000100:00100000:3.0:1788483057.403167:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 72 00000100:00100000:3.0:1788483057.403178:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+55:11260:x1875360087059200:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483057.403203:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483057.403225:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aaa8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2df expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403302:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403317:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403349:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403364:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403371:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403377:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403478:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1aabd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403488:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1aabd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403494:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1aabd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483057.403503:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788483057.403581:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403588:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403594:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403600:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.403610:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403617:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403628:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:3.0:1788483057.403631:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.403635:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403641:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1aaaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403654:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403660:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403665:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403670:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.403673:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403678:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403685:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:3.0:1788483057.403687:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.403709:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403715:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403753:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1aaa8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2df expref: 58 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403767:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1aabd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2df expref: 57 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.403774:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.403776:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483057.403778:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528c00, rc 0) 00000100:00100000:3.0:1788483057.403846:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+57:11260:x1875360087059200:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 669us (1033us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788483057.403853:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 72 00000100:00100000:0.0:1788483057.409456:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483057.409526:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483057.409837:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087059456 00000100:00100000:1.0:1788483057.409860:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087059456 00000100:00100000:1.0:1788483057.409927:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:1.0:1788483057.409937:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+57:2390:x1875360087059456:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483057.409952:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483057.409978:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1aabd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2df expref: 57 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.410009:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:1.0:1788483057.410014:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483057.410073:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:2390:x1875360087059456:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 136us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483057.410080:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:3.0:1788483057.410445:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087059328 00000100:00100000:3.0:1788483057.410451:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087059328 00000100:00100000:3.0:1788483057.410477:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 73 00000100:00100000:3.0:1788483057.410484:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:11260:x1875360087059328:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:3.0:1788483057.410535:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410549:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410559:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410603:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410610:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410616:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410622:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.410626:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410633:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410642:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.410645:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483057.410649:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.410655:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aacb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483057.410706:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:11260:x1875360087059328:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 221us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483057.410713:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 73 00000100:00100000:0.0:1788483057.418163:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483057.418302:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087059712 00000100:00100000:2.0:1788483057.418312:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087059712 00000100:00100000:2.0:1788483057.418364:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:2.0:1788483057.418375:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:11260:x1875360087059712:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483057.418605:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+57:11260:x1875360087059712:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 231us (451us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788483057.418630:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:1.0:1788483057.720185:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.720508:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087059968 00000100:00100000:3.0:1788483057.720519:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087059968 00000100:00100000:3.0:1788483057.720584:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 74 00000100:00100000:3.0:1788483057.720612:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+57:11278:x1875360087059968:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:3.0:1788483057.720641:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483057.720663:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aad2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2e6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.720782:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1aad9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.720799:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1aad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.720809:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1aad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483057.720821:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788483057.720959:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aad2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2e6 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.720979:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1aad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2e6 expref: 59 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.720999:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.721002:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788483057.721006:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528000, rc 0) 00000100:00100000:3.0:1788483057.723066:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+59:11278:x1875360087059968:12345-192.168.206.54@tcp:101:cat.0 Request processed in 2371us (2820us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788483057.723080:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 74 00000001:00080000:1.0:1788483057.725388:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:1.0:1788483057.725422:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788483057.725458:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788483057.725467:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a68c3dc7480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788483057.725471:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a68c3648b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c3dc73c0 00000020:00080000:1.0:1788483057.725474:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a68c3648500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c33b0400 00000020:00080000:1.0:1788483057.725535:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788483057.725684:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788483057.725738:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725761:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725768:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725774:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.725779:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725787:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725803:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a68c3183500) 00010000:00010000:3.0:1788483057.725806:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.725810:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725817:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1a8b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725835:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725851:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725857:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725861:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.725877:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725884:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725891:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:3.0:1788483057.725893:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.725896:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725901:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1a8be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725914:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725919:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725924:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725928:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.725930:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725935:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725940:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69f63d2300) 00010000:00010000:3.0:1788483057.725942:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.725949:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725955:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1a8fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725968:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725973:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725977:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725982:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.725984:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.725996:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726003:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.726005:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.726007:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726012:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1aa07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726021:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726026:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726036:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726042:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.726044:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726050:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726058:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.726060:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.726063:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726069:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1aa2a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726082:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726088:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726093:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726125:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.726128:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726143:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726152:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.726154:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.726167:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.726173:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1aa70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483057.726276:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483057.726294:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098684032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788483057.726359:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483057.726949:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098684032 00000100:00100000:1.0:1788483057.726958:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098684032 00000100:00100000:1.0:1788483057.727021:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788483057.727031:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098684032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788483057.727057:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788483057.727086:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9a15ee, atime: 0x6a9a15ee, ctime: 0x6a9a15ee, blocks: 0x8 00010000:00010000:1.0:1788483057.727093:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.727130:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788483057.727134:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483057.727140:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.727154:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.727174:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.727190:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483057.727208:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788483057.727342:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098684032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 312us (983us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788483057.727349:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1788483057.727585:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a68c3cc4700/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788483057.727592:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098684032:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788483057.727620:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483057.727625:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.727632:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483057.727636:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.727643:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.727673:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.727679:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1aae7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.727697:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483057.727700:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483057.727701:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483057.762130:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.762249:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087060096 00000100:00100000:3.0:1788483057.762259:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087060096 00000100:00100000:3.0:1788483057.762324:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 75 00000100:00100000:3.0:1788483057.762335:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11279:x1875360087060096:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483057.762359:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483057.762384:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aaee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2ed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.762455:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aaf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.762468:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.762481:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483057.762524:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788483057.762544:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483057.762565:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.762591:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aaee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ed expref: 15 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.762612:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ed expref: 14 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.762621:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:3.0:1788483057.762624:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483057.762627:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529c00, rc 0) 00000100:00100000:3.0:1788483057.762690:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11279:x1875360087060096:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 357us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483057.762698:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 75 00000100:00100000:2.0:1788483057.774686:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.774785:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087060480 00000100:00100000:3.0:1788483057.774795:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087060480 00000100:00100000:3.0:1788483057.774862:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788483057.774882:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11279:x1875360087060480:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483057.775188:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11279:x1875360087060480:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 316us (509us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788483057.775195:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:1.0:1788483057.783864:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483057.784014:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087060608 00000100:00100000:0.0:1788483057.784024:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087060608 00000100:00100000:0.0:1788483057.784092:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:0.0:1788483057.784140:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11279:x1875360087060608:12345-192.168.206.54@tcp:103:lfs.0 00010000:00010000:0.0:1788483057.784155:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788483057.784179:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1aa7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2d1 expref: 15 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483057.784200:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1aad9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2e6 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483057.784237:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1a97b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e28b expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483057.784248:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:0.0:1788483057.784253:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483057.784314:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:11279:x1875360087060608:12345-192.168.206.54@tcp:103:lfs.0 Request processed in 176us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483057.784322:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00010000:00010000:3.0:1788483057.784851:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483057.791783:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.791962:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087060736 00000100:00100000:3.0:1788483057.791971:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087060736 00000100:00100000:3.0:1788483057.792201:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 76 00000100:00100000:3.0:1788483057.792211:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:11279:x1875360087060736:12345-192.168.206.54@tcp:58:lfs.0 00010000:00010000:3.0:1788483057.792341:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.792358:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.792368:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483057.792586:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483057.792709:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788483057.792801:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788483057.793167:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:11279:x1875360087060736:12345-192.168.206.54@tcp:58:lfs.0 Request processed in 956us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483057.793176:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 76 00000100:00100000:3.0:1788483057.807147:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.807182:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.807219:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.807255:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.807279:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483057.807372:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087061376 00000100:00100000:1.0:1788483057.807382:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087061376 00000100:00100000:1.0:1788483057.807444:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087060992 00000100:00100000:1.0:1788483057.807447:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087060992 00000100:00100000:1.0:1788483057.807461:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087061248 00000100:00100000:1.0:1788483057.807464:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087061248 00000100:00100000:1.0:1788483057.807481:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 287 00000100:00100000:1.0:1788483057.807490:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087061376:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483057.807554:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087061376:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 64us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483057.807562:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 287 00000100:00100000:1.0:1788483057.807578:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 288 00000100:00100000:1.0:1788483057.807584:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087060992:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483057.807607:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087060992:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483057.807613:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 288 00000100:00100000:1.0:1788483057.807624:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 289 00000100:00100000:1.0:1788483057.807643:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087061248:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483057.807668:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087061248:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483057.807673:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 289 00000100:00100000:2.0:1788483057.807855:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087061120 00000100:00100000:2.0:1788483057.807860:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087061120 00000100:00100000:2.0:1788483057.807909:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:2.0:1788483057.807916:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087061120:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483057.807941:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087061120:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483057.807946:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:0.0:1788483057.808135:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087060864 00000100:00100000:0.0:1788483057.808139:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087060864 00000100:00100000:0.0:1788483057.808176:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 383 00000100:00100000:0.0:1788483057.808183:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087060864:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483057.808212:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087060864:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 30us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483057.808218:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 383 00000100:00080000:3.0:1788483057.808707:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483057.808713:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483057.808716:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483057.822253:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483057.822425:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087061504 00000100:00100000:3.0:1788483057.822435:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087061504 00000100:00100000:3.0:1788483057.822493:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 77 00000100:00100000:3.0:1788483057.822504:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:11281:x1875360087061504:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483057.822522:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483057.822541:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2f4 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822628:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822641:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822651:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822666:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822673:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822680:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822768:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822777:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822783:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483057.822821:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788483057.822825:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483057.822854:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822888:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822897:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822902:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822908:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822913:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.822916:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822923:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822934:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:3.0:1788483057.822937:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.822941:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822947:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822960:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822966:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822979:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822983:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483057.822986:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.822992:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.823000:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68c1c59d00) 00010000:00010000:3.0:1788483057.823002:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483057.823005:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.823011:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.823046:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 14 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.823059:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 13 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483057.823066:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483057.823068:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483057.823071:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528c00, rc 0) 00000100:00100000:3.0:1788483057.823176:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11281:x1875360087061504:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 674us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483057.823192:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 77 00000040:00080000:1.0:1788483058.232343:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483058.232352:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483058.232390:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788483058.232400:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483058.232525:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098684160:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788483058.232905:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6176f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483058.240146:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098684160:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788483058.242178:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.243821:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087061632 00000100:00100000:1.0:1788483058.243835:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087061632 00000100:00080000:3.0:1788483058.243920:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483058.243932:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 78 00000100:00100000:1.0:1788483058.243943:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11292:x1875360087061632:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483058.243975:0:6494:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788483058.244116:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11292:x1875360087061632:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 175us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483058.244124:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 78 00000100:00100000:1.0:1788483058.248682:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.248774:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087061760 00000100:00100000:3.0:1788483058.248784:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087061760 00000100:00100000:3.0:1788483058.248898:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 79 00000100:00100000:3.0:1788483058.248909:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11292:x1875360087061760:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788483058.248976:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249000:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249012:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249026:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249034:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249040:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249067:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249076:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249385:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483058.249427:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788483058.249431:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483058.249443:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249454:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249459:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249465:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249471:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483058.249475:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249483:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249494:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:3.0:1788483058.249497:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483058.249501:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249508:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ab1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249533:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249539:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249544:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249550:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483058.249552:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249559:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249566:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9a68c1c59d00) 00010000:00010000:3.0:1788483058.249568:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483058.249571:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249577:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ab26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249604:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249611:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249616:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249627:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483058.249630:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249635:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249642:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483058.249644:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483058.249647:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.249651:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ab2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483058.249722:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11292:x1875360087061760:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 Request processed in 814us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483058.249729:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 79 00000100:00100000:2.0:1788483058.253470:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.253673:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087062016 00000100:00100000:3.0:1788483058.253682:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087062016 00000100:00100000:3.0:1788483058.253746:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 80 00000100:00100000:3.0:1788483058.253758:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11292:x1875360087062016:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483058.253778:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483058.253799:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ab34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e2fb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.253926:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.253955:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.253966:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483058.253978:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788483058.254067:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.254075:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.254082:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.254087:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483058.254091:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.254136:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.254148:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483058.254151:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483058.254156:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.254519:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.254799:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ab34 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2fb expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.254812:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:2.0:1788483058.254814:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483058.254819:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ab34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2fb expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.254830:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:2.0:1788483058.254912:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087062016:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 1156us (1451us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788483058.254920:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 80 00000100:00100000:0.0:1788483058.258700:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483058.258805:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087062144 00000100:00100000:2.0:1788483058.258814:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087062144 00000100:00100000:2.0:1788483058.259003:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 81 00000100:00100000:2.0:1788483058.259013:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087062144:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788483058.259049:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788483058.259410:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087062144:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 398us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483058.259418:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 81 00000100:00100000:1.0:1788483058.267243:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483058.267665:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087062400 00000100:00100000:0.0:1788483058.267676:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087062400 00000100:00100000:0.0:1788483058.267758:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 82 00000100:00100000:0.0:1788483058.267769:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087062400:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483058.267790:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483058.267928:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788483058.267956:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aaf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ed expref: 14 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.268142:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483058.268148:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483058.268162:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ab49 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e302 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788483058.268521:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788483058.268666:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ab50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.268678:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.268688:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.270312:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ab49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e302 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.270338:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ab50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e302 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.270347:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68c3183600) 00010000:00010000:0.0:1788483058.270349:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483058.270352:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:0.0:1788483058.270430:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11292:x1875360087062400:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 2662us (3196us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788483058.270439:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 82 00000100:00100000:0.0:1788483058.284376:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.284622:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087062656 00000100:00100000:1.0:1788483058.284632:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087062656 00000100:00100000:1.0:1788483058.284689:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 83 00000100:00100000:1.0:1788483058.284775:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11292:x1875360087062656:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483058.284835:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483058.284879:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ab50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e302 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.284897:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68c3183600) 00010000:00010000:1.0:1788483058.284908:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483058.284934:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.284947:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.284957:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285018:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285026:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285032:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285214:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285222:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285229:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285235:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483058.285246:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285253:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285262:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:1.0:1788483058.285264:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483058.285267:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285273:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ab5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285282:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285289:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285295:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285300:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483058.285303:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285309:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285317:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe4820e9e (ffff9a69df303d00) 00010000:00010000:1.0:1788483058.285319:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483058.285327:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.285334:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1ab65 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe4820e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483058.285423:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087062656:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 724us (1059us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788483058.285431:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 83 00000100:00100000:2.0:1788483058.288886:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.290553:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087062784 00000100:00100000:1.0:1788483058.290565:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087062784 00000100:00100000:1.0:1788483058.290626:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 84 00000100:00100000:1.0:1788483058.290636:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087062784:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483058.290654:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483058.290678:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1ab6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e309 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.290712:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.290724:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.290734:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.291132:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1ab6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.291153:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.291334:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483058.291338:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483058.291341:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27c00, rc 0) 00000100:00100000:1.0:1788483058.291401:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11292:x1875360087062784:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 765us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483058.291409:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 84 00000100:00100000:0.0:1788483058.297864:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.298121:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087063040 00000100:00100000:1.0:1788483058.298131:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087063040 00000100:00100000:1.0:1788483058.298191:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 85 00000100:00100000:1.0:1788483058.298201:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11292:x1875360087063040:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483058.298285:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.298304:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.298317:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483058.298474:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788483058.298485:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350561387611ns, next at 351561385291ns, rc = 0 00000004:00010000:1.0:1788483058.298535:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d6647c5 reply state 0000000042aa3b8d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.298547:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.298555:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483058.298568:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788483058.298572:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483058.298671:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:11292:x1875360087063040:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 471us (815us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788483058.298678:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 85 00000100:00100000:0.0:1788483058.302773:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.302850:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087063168 00000100:00100000:3.0:1788483058.302879:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087063168 00000100:00100000:3.0:1788483058.302935:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 86 00000100:00100000:3.0:1788483058.302944:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:11292:x1875360087063168:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483058.302966:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483058.302996:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e310 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.303054:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.303068:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.303088:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:3.0:1788483058.303092:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483058.303125:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0031200, rc 0) 00000100:00100000:3.0:1788483058.303187:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:11292:x1875360087063168:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 243us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483058.303194:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 86 00000100:00100000:0.0:1788483058.307496:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483058.307595:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087063296 00000100:00100000:2.0:1788483058.307606:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087063296 00000100:00100000:2.0:1788483058.307650:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:2.0:1788483058.307658:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875360087063296:12345-192.168.206.54@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788483058.307696:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:2.0:1788483058.307725:0:8412:0:(genops.c:1385:class_connect()) connect: client d93ec387-f41f-455a-afdd-b6a72a2f59de, cookie 0x1d7ea3d89ea1ab88 00002000:00100000:2.0:1788483058.307737:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d93ec387-f41f-455a-afdd-b6a72a2f59de/ffff9a69c626e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788483058.307755:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788483058.307825:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788483058.307980:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9a69c626d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483058.308214:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2389:x1875360087063296:12345-192.168.206.54@tcp:8:lhsmtool_posix.0 Request processed in 389us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483058.308224:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:0.0:1788483058.310489:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.310655:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087063424 00000100:00100000:1.0:1788483058.310663:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087063424 00000100:00100000:1.0:1788483058.310791:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:1.0:1788483058.310802:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:0:x1875360087063424:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788483058.311091:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788483058.314818:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1788483058.314829:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000100:00100000:2.0:1788483058.315328:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:0:x1875360087063424:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 4522us (4839us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788483058.315340:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:1.0:1788483058.323510:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.323577:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087063680 00000100:00100000:3.0:1788483058.323596:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087063680 00000100:00100000:3.0:1788483058.323650:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:3.0:1788483058.323661:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:11292:x1875360087063680:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788483058.324123:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11292:x1875360087063680:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 462us (619us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788483058.324131:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:2.0:1788483058.332834:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.332943:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087063936 00000100:00100000:1.0:1788483058.332954:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087063936 00000100:00100000:1.0:1788483058.333066:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 87 00000100:00100000:1.0:1788483058.333076:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11292:x1875360087063936:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788483058.333215:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11292:x1875360087063936:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483058.333224:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 87 00000100:00100000:1.0:1788483058.338652:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.338775:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087064064 00000100:00100000:3.0:1788483058.338787:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087064064 00000100:00100000:3.0:1788483058.338852:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 88 00000100:00100000:3.0:1788483058.338863:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11292:x1875360087064064:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483058.338895:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483058.338916:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ab8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e317 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.339005:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1ab96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.339021:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.339032:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483058.339089:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483058.339245:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.339284:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ab8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e317 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.339303:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1ab96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e317 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.339312:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:2.0:1788483058.339314:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788483058.339318:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529c00, rc 0) 00000100:00100000:2.0:1788483058.339397:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11292:x1875360087064064:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 535us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483058.339404:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 88 00000100:00100000:1.0:1788483058.345582:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483058.345668:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087064192 00000100:00100000:0.0:1788483058.345678:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087064192 00000100:00100000:0.0:1788483058.345833:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:0.0:1788483058.345854:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087064192:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483058.345883:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483058.345906:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e31e expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483058.345934:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a15f1, blocks: 0x0 00010000:00010000:0.0:1788483058.345953:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1788483058.345962:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483058.345972:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.345994:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.346009:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8a00, rc 0) 00000100:00100000:0.0:1788483058.346079:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087064192:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 228us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483058.346282:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:3.0:1788483058.350139:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483058.350260:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087064448 00000100:00100000:0.0:1788483058.350271:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087064448 00000100:00100000:0.0:1788483058.350319:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 89 00000100:00100000:0.0:1788483058.350329:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11292:x1875360087064448:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483058.350743:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11292:x1875360087064448:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 413us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483058.350751:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 89 00000100:00100000:0.0:1788483058.354345:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.354602:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087064576 00000100:00100000:1.0:1788483058.354613:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087064576 00000100:00100000:1.0:1788483058.354675:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:1.0:1788483058.354686:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:11292:x1875360087064576:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483058.354703:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483058.354720:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e325 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.354761:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.354770:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483058.354775:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483058.354779:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.354811:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.354825:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 7 pid: 8411 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483058.354853:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875360098684288:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483058.354951:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6176b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483058.364769:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483058.369243:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875360098684288:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483058.369280:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.369300:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27200, rc 0) 00000100:00100000:0.0:1788483058.369376:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11292:x1875360087064576:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 14691us (15039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483058.369385:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:0.0:1788483058.371466:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087064704 00000100:00100000:0.0:1788483058.371484:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087064704 00010000:00010000:0.0:1788483058.371548:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 7 pid: 8411 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483058.371598:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:0.0:1788483058.371610:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087064704:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483058.371645:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483058.371670:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 7 pid: 8411 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.371685:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 7 pid: 8411 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.371709:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1ab9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e31e expref: 7 pid: 8411 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.371737:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483058.371742:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483058.371751:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.371761:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.371805:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483058.371820:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6479:1875360098684416:192.168.206.54@tcp:105: 00000100:00100000:0.0:1788483058.372397:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483058.379485:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6479:1875360098684416:192.168.206.54@tcp:105: 00010000:00010000:0.0:1788483058.379513:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483058.379576:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087064704:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 7967us (14814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483058.379587:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:3.0:1788483058.382129:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.382392:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087064832 00000100:00100000:1.0:1788483058.382403:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087064832 00002000:00100000:1.0:1788483058.382451:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a69f73f9880 x1875360087064832/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:564/0 lens 504/0 e 0 to 0 dl 1788483069 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483058.382475:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69f73f9880 with x1875360087064832 ext(0->8) 00002000:00010000:1.0:1788483058.382481:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69f73f9880 00000100:00100000:1.0:1788483058.382519:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:1.0:1788483058.382528:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087064832:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788483058.384020:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087064832:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 Request processed in 1485us (1915us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788483058.384032:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00002000:00100000:1.0:1788483058.384041:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a69f73f9880 x1875360087064832/t4294967303(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:564/0 lens 504/448 e 0 to 0 dl 1788483069 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483058.384051:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69f73f9880 with x1875360087064832 ext(0->8) 00002000:00010000:1.0:1788483058.384065:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69f73f9880 00000100:00100000:3.0:1788483058.386895:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.387564:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087064960 00000100:00100000:1.0:1788483058.387575:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087064960 00000100:00100000:1.0:1788483058.387634:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 90 00000100:00100000:1.0:1788483058.387645:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11292:x1875360087064960:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788483058.394109:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788483058.394138:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788483058.394163:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788483058.394270:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788483058.394292:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788483058.394309:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098684544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788483058.394374:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483058.394423:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098684544 00000100:00100000:1.0:1788483058.394430:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098684544 00000100:00100000:1.0:1788483058.394478:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788483058.394487:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098684544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788483058.394619:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788483058.394623:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788483057 00002000:00010000:1.0:1788483058.394625:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788483058.394635:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788483057 -> 1788483057 00002000:00010000:1.0:1788483058.394638:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788483058.394678:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098684544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (304us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788483058.394686:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1788483058.394737:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69edae0700/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788483058.394744:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098684544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788483058.394856:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11292:x1875360087064960:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 Request processed in 7211us (7967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483058.394865:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 90 00010000:00010000:3.0:1788483058.395180:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.395191:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.395198:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.395216:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483058.395221:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.395229:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.395245:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:3.0:1788483058.395248:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788483058.395253:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.395260:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ab7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788483058.395283:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483058.400006:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483058.400483:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087065088 00000100:00100000:2.0:1788483058.404082:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087065088 00000100:00100000:2.0:1788483058.404180:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:2.0:1788483058.404190:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087065088:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788483058.406629:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788483058.406643:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1788483058.406816:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087065088:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 Request processed in 2623us (6825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483058.406826:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:0.0:1788483058.412536:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.412617:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087065344 00000100:00100000:1.0:1788483058.412628:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087065344 00000100:00100000:1.0:1788483058.412685:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 91 00000100:00100000:1.0:1788483058.412695:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087065344:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483058.412906:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483058.412936:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1ab96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e317 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.412957:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483058.412962:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483058.413001:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.413015:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.413024:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483058.413191:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090bf0c71 reply state 00000000f7180d85 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.413203:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.413210:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483058.413212:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788483058.413215:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483058.413319:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11292:x1875360087065344:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 623us (791us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788483058.413326:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 91 00000100:00100000:3.0:1788483058.416287:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.416394:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087065472 00000100:00100000:1.0:1788483058.416404:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087065472 00000100:00100000:1.0:1788483058.416655:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:1.0:1788483058.416666:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087065472:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788483058.416825:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788483058.416828:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788483057 -> 1788483056 00002000:00010000:1.0:1788483058.416831:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788483054 00002000:00010000:1.0:1788483058.416832:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788483057 -> 1788483056 00002000:00010000:1.0:1788483058.416835:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788483058.416915:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087065472:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 250us (637us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788483058.416924:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:2.0:1788483058.423852:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.424044:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087065728 00000100:00100000:3.0:1788483058.424399:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087065728 00000100:00100000:3.0:1788483058.424485:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 92 00000100:00100000:3.0:1788483058.424496:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:11292:x1875360087065728:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788483058.424558:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.424576:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.424597:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.424631:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.424645:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 15 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483058.424658:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098684672:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483058.424780:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483058.429367:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098684672:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483058.429398:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483058.432144:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483058.432396:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087065856 00000100:00100000:0.0:1788483058.432406:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087065856 00010000:00010000:0.0:1788483058.432447:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 16 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483058.432573:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:0.0:1788483058.432583:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:2392:x1875360087065856:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483058.432599:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483058.432606:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 16 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.432620:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 16 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.432644:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1ab73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e309 expref: 16 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.432657:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:0.0:1788483058.432663:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.432671:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.432678:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.432721:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483058.432773:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:2392:x1875360087065856:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 191us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483058.432781:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00010000:00010000:1.0:1788483058.432817:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.432825:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.434608:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.434622:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.434630:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.434636:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483058.434641:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.434650:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.434665:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:1.0:1788483058.434668:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788483058.434672:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.434678:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1abb2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483058.434750:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087065728:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 Request processed in 10254us (10905us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788483058.434766:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 92 00000100:00100000:0.0:1788483058.439501:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483058.439571:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087065984 00000100:00100000:2.0:1788483058.439582:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087065984 00000100:00100000:2.0:1788483058.439638:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:2.0:1788483058.439648:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087065984:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788483058.439711:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.439732:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.439740:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483058.439745:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483058.439749:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.439790:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.439806:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 7 pid: 8409 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483058.439820:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875360098684800:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483058.439931:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483058.442982:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875360098684800:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483058.443022:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483058.444506:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.447664:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087066112 00000100:00100000:3.0:1788483058.447679:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087066112 00010000:00010000:3.0:1788483058.447726:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 8 pid: 8409 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483058.447766:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:3.0:1788483058.447777:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087066112:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483058.447790:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483058.447812:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 8 pid: 8409 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.447829:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 8 pid: 8409 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.447883:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b257a2/0x1d7ea3d89ea1aba4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e325 expref: 8 pid: 8409 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.447899:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483058.447904:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483058.447910:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.447920:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.447955:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483058.448012:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087066112:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 236us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483058.448020:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00010000:00010000:3.0:1788483058.449205:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449221:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449246:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449254:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449284:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449291:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483058.449295:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449303:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449320:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.449327:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1abb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483058.450528:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087065984:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 Request processed in 10874us (11041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483058.450540:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:0.0:1788483058.454436:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.454502:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087066368 00000100:00100000:1.0:1788483058.454512:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087066368 00000100:00100000:1.0:1788483058.454564:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 93 00000100:00100000:1.0:1788483058.454573:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11292:x1875360087066368:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788483058.454646:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.454662:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 14 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.454671:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.454702:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 14 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.454716:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 14 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483058.454729:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098684928:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483058.454802:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c61769c0 going to sleep for 11 seconds 00000040:00080000:2.0:1788483058.455314:0:14184:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483058.455319:0:14184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483058.455342:0:14184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788483058.455353:0:14184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483058.459916:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098684928:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483058.459947:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483058.473157:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483058.473662:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087066496 00000100:00100000:1.0:1788483058.473679:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087066496 00010000:00010000:1.0:1788483058.473737:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 15 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483058.473780:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:1.0:1788483058.473790:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:2393:x1875360087066496:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483058.473803:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483058.473809:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 15 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.473823:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 15 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474074:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1aa00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2ae expref: 15 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474091:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:1.0:1788483058.474125:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474137:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474144:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474180:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483058.474234:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:2393:x1875360087066496:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 445us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483058.474251:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 62 00010000:00010000:1.0:1788483058.474330:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474340:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474505:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474518:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474526:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474556:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.474569:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 14 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483058.474581:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098685056:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483058.474630:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6176300 going to sleep for 11 seconds 00000100:00100000:3.0:1788483058.490081:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.490123:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087066624 00000100:00100000:3.0:1788483058.490133:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087066624 00010000:00010000:3.0:1788483058.490172:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 15 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483058.490224:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:3.0:1788483058.490233:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:2390:x1875360087066624:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483058.490248:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483058.490255:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 15 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.490282:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 15 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.490307:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:3.0:1788483058.490313:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.490324:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.490332:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.490350:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483058.490393:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:2390:x1875360087066624:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 161us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483058.490400:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 63 00010000:00010000:1.0:1788483058.492927:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ab81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e310 expref: 14 pid: 6495 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483058.492950:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098685056:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483058.492984:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.492994:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483058.493000:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788483058.493119:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788483058.494348:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788483058.494411:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788483058.494500:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098685184:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788483058.494565:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483058.494604:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6176180 going to sleep for 11 seconds 00000100:00100000:2.0:1788483058.494761:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098685184 00000100:00100000:2.0:1788483058.494769:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098685184 00000100:00100000:2.0:1788483058.494822:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788483058.494832:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8434:x1875360098685184:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788483058.494951:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8434:x1875360098685184:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483058.494958:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788483058.495131:0:8434:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788483058.495139:0:8434:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69edae0700, transno 4294967304 00000100:00100000:3.0:1788483058.495155:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098685184:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788483058.495310:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788483058.495358:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098685312:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788483058.495390:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483058.495415:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788483058.495435:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098685312 00000100:00100000:2.0:1788483058.495440:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098685312 00000100:00100000:2.0:1788483058.495474:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788483058.495482:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8434:x1875360098685312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788483058.495576:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8434:x1875360098685312:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (186us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788483058.495583:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788483058.495612:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098685312:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788483058.495643:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495653:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495661:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495667:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483058.495671:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495688:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495717:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:2.0:1788483058.495721:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483058.495732:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495745:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1abc7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495772:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495779:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495785:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495790:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483058.495793:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495799:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495806:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:2.0:1788483058.495809:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483058.495812:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.495827:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aafc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.496083:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.496118:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 17 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.496128:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.496152:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 17 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.496274:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 17 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483058.496287:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098685440:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483058.496349:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788483058.508474:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.508775:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098685440:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483058.508800:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483058.509142:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087066752 00000100:00100000:0.0:1788483058.509151:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087066752 00010000:00010000:0.0:1788483058.509196:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 18 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483058.509241:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:0.0:1788483058.509251:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:2393:x1875360087066752:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483058.509265:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483058.509272:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 18 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.509285:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 18 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.509308:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1ab18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e2f4 expref: 18 pid: 8434 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.509322:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:0.0:1788483058.509333:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.509342:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.509349:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483058.509381:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483058.509434:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:2393:x1875360087066752:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 184us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483058.509442:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00010000:00010000:3.0:1788483058.512536:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512550:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512564:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512571:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512578:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512583:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483058.512587:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512594:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512609:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483058.512623:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483058.512628:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512635:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512649:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512655:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512660:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512665:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483058.512668:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512674:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512683:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69f63d2b00) 00010000:00010000:3.0:1788483058.512685:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483058.512687:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.512692:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1abc0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483058.513023:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:11292:x1875360087066368:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 58445us (58589us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788483058.513042:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 93 00000020:00080000:3.0:1788483058.513048:0:8434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788483058.513279:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483058.513284:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483058.513301:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788483058.513307:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483058.516347:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483058.517443:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087067008 00000100:00100000:3.0:1788483058.517456:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087067008 00000100:00100000:3.0:1788483058.517521:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788483058.517531:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:11292:x1875360087067008:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788483058.518002:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788483058.518045:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788483058.518086:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.518808:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.518822:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.518830:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.518846:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.518851:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483058.518892:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788483058.519007:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:11292:x1875360087067008:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 1474us (2666us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788483058.519029:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000020:00080000:3.0:1788483058.519035:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788483058.519220:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483058.519228:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.519235:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483058.519240:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.519247:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.519266:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:2.0:1788483058.519269:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788483058.519273:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.519279:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1abd5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483058.519294:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483058.519296:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483058.519297:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483058.808702:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483058.936499:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098685568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483058.936589:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483058.936724:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098685568 00000100:00100000:2.0:1788483058.936732:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098685568 00000100:00100000:2.0:1788483058.936777:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788483058.936786:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098685568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483058.936818:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788483058.936883:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098685568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483058.936891:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788483058.936972:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098685568:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483059.832391:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483059.961426:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098685696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483059.961494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483059.961575:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098685696 00000100:00100000:3.0:1788483059.961583:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098685696 00000100:00100000:3.0:1788483059.961634:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788483059.961644:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098685696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483059.961675:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788483059.961719:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098685696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483059.961727:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788483059.962055:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098685696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483059.962274:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098685824:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962315:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962341:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098686336:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962366:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962393:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098686848:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962417:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962439:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788483059.962444:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098686208:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962468:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962488:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098686720:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962520:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098687232:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962539:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962564:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098685952:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962587:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962605:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098686464:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962625:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962644:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098686976:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962662:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962679:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788483059.962684:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098686080:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962735:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098686592:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962758:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962768:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098687104:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962786:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483059.962810:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098685824 00000100:00100000:2.0:1788483059.962815:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098685824 00000100:00100000:2.0:1788483059.962883:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788483059.962899:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098685824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.962969:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098685824:12345-0@lo:400:kworker.0 Request processed in 71us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.962977:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788483059.963007:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686336 00000100:00100000:2.0:1788483059.963011:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686336 00000100:00100000:2.0:1788483059.963034:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686080 00000100:00100000:2.0:1788483059.963037:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686080 00000100:00100000:2.0:1788483059.963050:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788483059.963057:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098686336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963091:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098686336:12345-0@lo:400:kworker.0 Request processed in 35us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963118:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788483059.963131:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788483059.963138:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098686080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963172:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098686080:12345-0@lo:400:kworker.0 Request processed in 35us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963178:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788483059.963197:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686848 00000100:00100000:2.0:1788483059.963201:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686848 00000100:00100000:2.0:1788483059.963230:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686720 00000100:00100000:2.0:1788483059.963233:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686720 00000100:00100000:2.0:1788483059.963244:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098687232 00000100:00100000:2.0:1788483059.963246:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098687232 00000100:00100000:2.0:1788483059.963260:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788483059.963266:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1875360098686848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963296:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1875360098686848:12345-0@lo:400:kworker.0 Request processed in 31us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963309:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788483059.963322:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788483059.963327:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098686720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963372:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098686720:12345-0@lo:400:kworker.0 Request processed in 45us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963379:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788483059.963391:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788483059.963397:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098687232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963422:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098687232:12345-0@lo:400:kworker.0 Request processed in 26us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963428:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788483059.963447:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686208 00000100:00100000:2.0:1788483059.963451:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686208 00000100:00100000:2.0:1788483059.963471:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098685952 00000100:00100000:2.0:1788483059.963474:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098685952 00000100:00100000:2.0:1788483059.963485:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686464 00000100:00100000:2.0:1788483059.963487:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686464 00000100:00100000:2.0:1788483059.963498:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686976 00000100:00100000:2.0:1788483059.963500:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686976 00000100:00100000:2.0:1788483059.963517:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098686592 00000100:00100000:2.0:1788483059.963520:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098686592 00000100:00100000:2.0:1788483059.963530:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098687104 00000100:00100000:2.0:1788483059.963533:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098687104 00000100:00100000:2.0:1788483059.963546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788483059.963552:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098686208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963584:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098686208:12345-0@lo:400:kworker.0 Request processed in 31us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963590:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788483059.963610:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788483059.963616:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098685952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963644:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098685952:12345-0@lo:400:kworker.0 Request processed in 28us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963650:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788483059.963662:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788483059.963668:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098686464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963694:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098686464:12345-0@lo:400:kworker.0 Request processed in 27us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963699:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788483059.963711:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788483059.963717:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098686976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963743:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098686976:12345-0@lo:400:kworker.0 Request processed in 26us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963748:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788483059.963759:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788483059.963765:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098686592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963790:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098686592:12345-0@lo:400:kworker.0 Request processed in 26us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963795:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788483059.963806:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788483059.963812:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098687104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963837:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098687104:12345-0@lo:400:kworker.0 Request processed in 25us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483059.963842:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788483059.963931:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098686080:0@lo:400:kworker.0 00010000:00080000:2.0:1788483059.963948:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e44380 x1875360098686592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483059.963960:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098686592:0@lo:400:kworker.0 00010000:00080000:2.0:1788483059.963972:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e45180 x1875360098687104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483059.963981:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098687104:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.963993:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098685952:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964003:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098686464:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964013:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098686976:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964063:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098686208:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964073:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098686720:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964083:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098687232:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964092:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098685824:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964125:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098686336:0@lo:400:kworker.0 00000100:00100000:2.0:1788483059.964137:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098686848:0@lo:400:kworker.0 00000100:00080000:2.0:1788483059.964190:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483059.964196:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483059.964198:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483059.964201:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788483060.450611:0:14235:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483060.450621:0:14235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483060.450644:0:14235:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788483060.450650:0:14235:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788483060.473917:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483060.473938:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efeb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098687360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483060.473999:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483060.474054:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098687360 00000100:00100000:3.0:1788483060.474061:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098687360 00000100:00100000:3.0:1788483060.474143:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788483060.474154:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098687360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483060.474183:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788483060.474228:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098687360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483060.474235:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000001:00080000:0.0:1788483060.476766:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788483060.476783:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788483060.478555:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efeb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098687360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483060.630339:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483060.630528:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087067264 00000100:00100000:0.0:1788483060.630538:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087067264 00000100:00100000:0.0:1788483060.630598:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 94 00000100:00100000:0.0:1788483060.630609:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:11313:x1875360087067264:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483060.630632:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483060.630650:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1abdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e32c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.630753:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1abe3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.630767:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1abe3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.630795:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1abe3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483060.630815:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788483060.630934:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1abdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e32c expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.630963:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1abe3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e32c expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.630972:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483060.630975:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788483060.630978:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8200, rc 0) 00000100:00100000:0.0:1788483060.631036:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11313:x1875360087067264:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 428us (705us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788483060.631044:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 94 00000100:00080000:3.0:1788483060.631353:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483060.635168:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483060.635279:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087067392 00000100:00100000:2.0:1788483060.635289:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087067392 00000100:00100000:2.0:1788483060.635334:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 95 00000100:00100000:2.0:1788483060.635343:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11313:x1875360087067392:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:2.0:1788483060.635413:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635429:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635440:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635454:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635462:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635468:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635538:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635546:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635554:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483060.635598:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635619:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635626:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635633:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635639:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483060.635643:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635651:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635663:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483060.635666:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483060.635670:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635677:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1abf1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635690:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635695:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635701:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635712:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483060.635715:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635722:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635730:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa200) 00010000:00010000:2.0:1788483060.635732:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483060.635735:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635741:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1abf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635754:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635759:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635780:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635784:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483060.635787:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635792:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635810:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a69c32fa900) 00010000:00010000:2.0:1788483060.635812:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483060.635814:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.635819:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1abff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483060.635913:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11313:x1875360087067392:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 569us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483060.635921:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 95 00000100:00100000:1.0:1788483060.713651:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483060.714133:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087067648 00000100:00100000:0.0:1788483060.714143:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087067648 00000100:00100000:0.0:1788483060.714198:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 96 00000100:00100000:0.0:1788483060.714208:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11316:x1875360087067648:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483060.714226:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483060.714244:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ac06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e333 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714312:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714327:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714355:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714369:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714376:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714382:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714495:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714504:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714511:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483060.714521:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788483060.714590:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714598:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714605:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714611:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483060.714621:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714630:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714642:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483060.714645:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483060.714649:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714656:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714668:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714674:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714679:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714685:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483060.714687:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714692:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714699:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68c3183f00) 00010000:00010000:0.0:1788483060.714701:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483060.714711:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714716:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714759:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ac06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714772:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.714779:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:0.0:1788483060.714781:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483060.714783:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9000, rc 0) 00000100:00100000:0.0:1788483060.714877:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11316:x1875360087067648:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 670us (1234us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788483060.714884:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 96 00000100:00100000:2.0:1788483060.718641:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483060.720028:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087067776 00000100:00100000:0.0:1788483060.720042:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087067776 00000100:00100000:0.0:1788483060.720126:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 97 00000100:00100000:0.0:1788483060.720136:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11316:x1875360087067776:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:0.0:1788483060.720213:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720229:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720240:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720292:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720298:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720304:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720310:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483060.720314:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720322:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720333:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:0.0:1788483060.720336:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483060.720340:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.720346:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483060.720414:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11316:x1875360087067776:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 279us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483060.720421:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 97 00000100:00100000:1.0:1788483060.722957:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483060.723051:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087068032 00000100:00100000:2.0:1788483060.723060:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087068032 00000100:00100000:2.0:1788483060.723138:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:2.0:1788483060.723148:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4624850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11316:x1875360087068032:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483060.723368:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4624850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:11316:x1875360087068032:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 220us (418us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788483060.723376:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:1.0:1788483060.825624:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483060.826019:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087068288 00000100:00100000:0.0:1788483060.826030:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087068288 00000100:00100000:0.0:1788483060.826092:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 98 00000100:00100000:0.0:1788483060.826143:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:10832:x1875360087068288:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483060.826176:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483060.826195:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e33a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.826293:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.826308:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.826316:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.826348:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.826361:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 24 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483060.826375:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875360098687488:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483060.826467:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69cb3d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788483060.829416:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875360098687488:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483060.829443:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483060.830406:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483060.830621:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087068416 00000100:00100000:3.0:1788483060.830629:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087068416 00010000:00010000:3.0:1788483060.830664:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 25 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483060.830705:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:3.0:1788483060.830715:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:2392:x1875360087068416:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483060.830727:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483060.830734:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 25 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.830747:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 25 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.830769:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1ac1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e333 expref: 25 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.830784:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:3.0:1788483060.830789:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.830798:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.830814:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.830851:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483060.830902:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.830912:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483060.830914:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:2392:x1875360087068416:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 199us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483060.830925:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 65 00000004:00200000:2.0:1788483060.830943:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788483060.831059:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ac30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.831075:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.831083:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:2.0:1788483060.831085:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483060.831088:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:2.0:1788483060.831177:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:10832:x1875360087068288:12345-192.168.206.54@tcp:101:bash.0 Request processed in 5036us (5560us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788483060.831186:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 98 00000100:00100000:1.0:1788483060.838793:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483060.839292:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087068544 00000100:00100000:0.0:1788483060.839303:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087068544 00000100:00100000:0.0:1788483060.839358:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 99 00000100:00100000:0.0:1788483060.839368:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:10832:x1875360087068544:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483060.839389:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483060.839411:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e341 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.839462:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ac4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.839474:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ac4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.839486:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ac4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.839592:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e341 expref: 26 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.839609:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ac4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e341 expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483060.839617:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:0.0:1788483060.839620:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483060.839624:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8000, rc 0) 00000100:00100000:0.0:1788483060.839733:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:10832:x1875360087068544:12345-192.168.206.54@tcp:101:bash.0 Request processed in 365us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483060.839741:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 99 00000100:00100000:1.0:1788483060.846647:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483060.846748:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087068800 00000100:00100000:2.0:1788483060.846757:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087068800 00000100:00100000:2.0:1788483060.846823:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 100 00000100:00100000:2.0:1788483060.846833:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:10832:x1875360087068800:12345-192.168.206.54@tcp:36:bash.0 00010000:00010000:2.0:1788483060.847049:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.847079:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.847089:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483060.847168:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788483060.847205:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ae86822 reply state 00000000a87c2402 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.847218:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.847225:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:2.0:1788483060.847228:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483060.847231:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788483060.847278:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788483060.847372:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:10832:x1875360087068800:12345-192.168.206.54@tcp:36:bash.0 Request processed in 539us (732us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788483060.847379:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 100 00000020:00080000:2.0:1788483060.847383:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788483060.849934:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483060.850021:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087068928 00000100:00100000:3.0:1788483060.850030:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087068928 00000100:00100000:3.0:1788483060.850086:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 101 00000100:00100000:3.0:1788483060.850125:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:10832:x1875360087068928:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:3.0:1788483060.850155:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483060.850175:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ac5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e348 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.850245:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ac5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e348 expref: 30 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.850259:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ac5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e348 expref: 30 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483060.850277:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:3.0:1788483060.850281:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483060.850285:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529400, rc 0) 00000100:00100000:3.0:1788483060.850335:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:10832:x1875360087068928:12345-192.168.206.54@tcp:101:bash.0 Request processed in 241us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483060.850343:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 101 00000100:00100000:3.0:1788483060.861360:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483060.861483:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087069056 00000100:00100000:2.0:1788483060.861492:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087069056 00000100:00100000:2.0:1788483060.861564:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:2.0:1788483060.861576:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:10832:x1875360087069056:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483060.861594:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483060.861618:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e34f expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483060.861645:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a15f0, atime: 0x6a9a15ee, ctime: 0x6a9a15f0, blocks: 0x8 00010000:00010000:2.0:1788483060.861666:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1788483060.861671:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483060.861680:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.861700:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483060.861727:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1e00, rc 0) 00000100:00100000:2.0:1788483060.861789:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:10832:x1875360087069056:12345-192.168.206.54@tcp:101:bash.0 Request processed in 215us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483060.861797:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 41 00010000:00010000:0.0:1788483060.861910:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788483060.862057:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483060.864272:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483060.864383:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087069184 00000100:00100000:0.0:1788483060.864394:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087069184 00002000:00010000:0.0:1788483060.864430:0:8415:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788483060.864434:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69d1cf1880 with x1875360087069184 ext(0->18446744073709551615) 00002000:00010000:0.0:1788483060.864444:0:8415:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69d1cf1880. 00000100:00100000:0.0:1788483060.864477:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:0.0:1788483060.864494:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2390:x1875360087069184:12345-192.168.206.54@tcp:10:bash.0 00002000:00010000:0.0:1788483060.864741:0:8415:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788483060.864745:0:8415:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788483056 -> 1788483060 00002000:00010000:0.0:1788483060.864748:0:8415:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788483054 -> 1788483054 00002000:00010000:0.0:1788483060.864750:0:8415:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788483056 -> 1788483060 00002000:00010000:0.0:1788483060.864753:0:8415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788483060.864815:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2390:x1875360087069184:12345-192.168.206.54@tcp:10:bash.0 Request processed in 322us (550us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788483060.864822:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00002000:00010000:0.0:1788483060.864826:0:8415:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788483060.864829:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69d1cf1880 with x1875360087069184 ext(0->18446744073709551615) 00002000:00010000:0.0:1788483060.864835:0:8415:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69d1cf1880. 00000100:00100000:2.0:1788483061.012780:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.013060:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087069312 00000100:00100000:0.0:1788483061.013070:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087069312 00000100:00100000:0.0:1788483061.013158:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 102 00000100:00100000:0.0:1788483061.013169:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:11330:x1875360087069312:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:0.0:1788483061.013246:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013263:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013275:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013289:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013312:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013320:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013396:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013406:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013413:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483061.013454:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013465:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013471:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013478:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013484:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.013488:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013495:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013514:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483061.013517:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.013521:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013527:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013540:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013547:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013553:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013559:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.013562:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013567:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013574:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68c3183f00) 00010000:00010000:0.0:1788483061.013576:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.013579:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013584:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013610:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013617:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013623:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013629:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.013632:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013639:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013646:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:0.0:1788483061.013649:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.013652:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.013657:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.013742:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:11330:x1875360087069312:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 574us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.013750:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 102 00000100:00100000:1.0:1788483061.101364:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.101666:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087069568 00000100:00100000:0.0:1788483061.101676:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087069568 00000100:00100000:0.0:1788483061.101734:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 103 00000100:00100000:0.0:1788483061.101757:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:11333:x1875360087069568:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483061.101777:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483061.101802:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e356 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.101881:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.101895:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.101906:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.101920:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.101928:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.101935:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102121:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ac92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102132:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ac92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102140:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ac92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483061.102160:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788483061.102236:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102244:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102249:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102254:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.102258:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102264:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102274:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483061.102277:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.102281:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102286:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ac84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102296:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102301:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102316:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102321:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.102324:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102329:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102337:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68c3183f00) 00010000:00010000:0.0:1788483061.102339:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.102342:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102348:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ac8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102418:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ac7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e356 expref: 33 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102432:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ac92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e356 expref: 32 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.102439:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:0.0:1788483061.102441:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788483061.102443:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9a00, rc 0) 00000100:00100000:0.0:1788483061.102559:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11333:x1875360087069568:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 802us (1202us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788483061.102574:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 103 00000100:00100000:1.0:1788483061.108681:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.108867:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087069696 00000100:00100000:0.0:1788483061.108876:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087069696 00000100:00100000:0.0:1788483061.108937:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 104 00000100:00100000:0.0:1788483061.109075:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11333:x1875360087069696:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:0.0:1788483061.109166:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.109184:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.109193:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.109229:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.109243:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 32 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.109257:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098687616:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483061.109388:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3866900 going to sleep for 11 seconds 00000100:00100000:0.0:1788483061.116961:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098687616:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483061.116999:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483061.117162:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.117283:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087069952 00000100:00100000:3.0:1788483061.117290:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087069952 00000100:00100000:3.0:1788483061.117349:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788483061.117358:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:6163:x1875360087069952:12345-192.168.206.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788483061.117621:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:6163:x1875360087069952:12345-192.168.206.54@tcp:35:ldlm_bl.0 Request processed in 263us (469us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788483061.117629:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:1.0:1788483061.120021:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.120150:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087070080 00000100:00100000:0.0:1788483061.120180:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087070080 00010000:00010000:0.0:1788483061.120216:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 34 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.120254:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:0.0:1788483061.120263:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:2392:x1875360087070080:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483061.120277:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483061.120283:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 34 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.120297:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 34 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.120319:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ac37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e33a expref: 34 pid: 6494 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.120335:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:0.0:1788483061.120339:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.120348:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.120356:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.120390:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483061.120445:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:2392:x1875360087070080:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 183us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.120463:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 66 00010000:00010000:2.0:1788483061.120756:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120766:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120801:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120808:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120814:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120819:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483061.120823:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120830:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120839:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:2.0:1788483061.120848:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483061.120864:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.120872:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1aca0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483061.120926:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11333:x1875360087069696:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 11980us (12254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.120934:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 104 00000100:00100000:1.0:1788483061.127759:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.127864:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087070336 00000100:00100000:3.0:1788483061.127875:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087070336 00000100:00100000:3.0:1788483061.127934:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:3.0:1788483061.127944:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:11333:x1875360087070336:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483061.129912:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:11333:x1875360087070336:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 1963us (2154us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788483061.129926:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:0.0:1788483061.222888:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.223072:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087070592 00000100:00100000:3.0:1788483061.223083:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087070592 00000100:00100000:3.0:1788483061.223173:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 105 00000100:00100000:3.0:1788483061.223183:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:11344:x1875360087070592:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:3.0:1788483061.223205:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483061.223225:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1aca7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e35d expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223309:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223340:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223352:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223369:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223376:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223383:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223498:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1acbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223507:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1acbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223514:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1acbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483061.223523:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788483061.223592:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223600:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223607:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223619:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483061.223624:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223631:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223642:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:3.0:1788483061.223646:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483061.223651:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223657:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223670:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223676:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223682:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223687:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483061.223690:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223695:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223712:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68c1c53000) 00010000:00010000:3.0:1788483061.223714:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483061.223717:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223723:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1acb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223760:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1aca7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e35d expref: 36 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223774:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1acbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e35d expref: 35 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.223782:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:3.0:1788483061.223784:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483061.223786:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528000, rc 0) 00000100:00100000:3.0:1788483061.223868:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:11344:x1875360087070592:12345-192.168.206.54@tcp:101:cat.0 Request processed in 685us (989us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788483061.223876:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 105 00000100:00100000:2.0:1788483061.232307:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483061.232977:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087070848 00000100:00100000:1.0:1788483061.232986:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087070848 00000100:00100000:1.0:1788483061.233046:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:1.0:1788483061.233055:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:11344:x1875360087070848:12345-192.168.206.54@tcp:35:cat.0 00000100:00100000:1.0:1788483061.233339:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:11344:x1875360087070848:12345-192.168.206.54@tcp:35:cat.0 Request processed in 285us (1040us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788483061.233348:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:1.0:1788483061.285754:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.289496:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087071104 00000100:00100000:2.0:1788483061.289512:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087071104 00000100:00100000:2.0:1788483061.289588:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 106 00000100:00100000:2.0:1788483061.289597:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:11345:x1875360087071104:12345-192.168.206.54@tcp:36:rm.0 00010000:00010000:2.0:1788483061.289650:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788483061.289674:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ac5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e348 expref: 36 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289700:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1acbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e35d expref: 35 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289718:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ac92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e356 expref: 34 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289744:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ac4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e341 expref: 33 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289755:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:2.0:1788483061.289774:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483061.289796:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289808:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289818:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289832:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289838:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289845:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289924:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289932:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.289939:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483061.292911:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788483061.292935:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353555837851ns, next at 354555833206ns, rc = 0 00010000:00010000:2.0:1788483061.293006:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293050:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293061:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293070:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293077:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293092:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293147:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483061.293168:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293175:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293181:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293187:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483061.293192:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293199:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293219:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:2.0:1788483061.293222:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788483061.293226:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293231:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1acd8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293249:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293255:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293260:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293264:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483061.293266:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293271:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293277:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483061.293279:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483061.293281:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293287:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1acca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483061.293305:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066efb3db reply state 000000006128342a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293315:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.293320:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa500) 00010000:00010000:2.0:1788483061.293322:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483061.293325:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483061.293412:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:11345:x1875360087071104:12345-192.168.206.54@tcp:36:rm.0 Request processed in 3812us (7672us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788483061.293420:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 106 00010000:00010000:0.0:1788483061.294074:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483061.294139:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.294147:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483061.294151:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.294166:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.294177:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:0.0:1788483061.294180:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788483061.294183:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.294188:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1acdf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.294201:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483061.294203:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483061.294205:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483061.349965:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.350059:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087071360 00000100:00100000:3.0:1788483061.350069:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087071360 00000100:00100000:3.0:1788483061.350196:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 107 00000100:00100000:3.0:1788483061.350205:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:11351:x1875360087071360:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:3.0:1788483061.350228:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483061.350246:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ace6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e364 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.350353:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.350367:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.350377:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.350386:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.350393:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.350399:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788483061.350705:0:8434:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788483061.351305:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351316:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351324:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351356:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351373:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351379:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351385:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483061.351389:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351396:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351409:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:3.0:1788483061.351412:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483061.351416:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351422:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1aced lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483061.351437:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d43587e0 reply state 00000000c0476af6 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351447:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351454:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa500) 00010000:00010000:3.0:1788483061.351457:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483061.351460:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788483061.351486:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ace6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 37 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351506:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 36 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.351513:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68c1c53000) 00010000:00010000:3.0:1788483061.351516:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483061.351518:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529c00, rc 0) 00000100:00100000:3.0:1788483061.351579:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:11351:x1875360087071360:12345-192.168.206.54@tcp:101:bash.0 Request processed in 1374us (1631us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788483061.351586:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 107 00000100:00100000:1.0:1788483061.356605:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.358479:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087071488 00000100:00100000:2.0:1788483061.358492:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087071488 00000100:00100000:2.0:1788483061.358623:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:2.0:1788483061.358635:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087071488:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483061.358651:0:8551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483061.358672:0:8551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e36b expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483061.358697:0:8551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483061.358714:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1788483061.358719:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483061.358728:0:8551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 6 pid: 8551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.358747:0:8551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 6 pid: 8551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.358784:0:8551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:2.0:1788483061.358866:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087071488:12345-192.168.206.54@tcp:101:bash.0 Request processed in 233us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.358873:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00080000:3.0:1788483061.361016:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483061.363544:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.363630:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087071616 00000100:00100000:0.0:1788483061.363640:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087071616 00000100:00100000:0.0:1788483061.363695:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:0.0:1788483061.363704:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:11351:x1875360087071616:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483061.363720:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483061.363749:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e372 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.363791:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 7 pid: 8551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.363800:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483061.363804:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483061.363809:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.363862:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 7 pid: 8551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.363877:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 7 pid: 8551 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.363890:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1875360098687744:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483061.363979:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3866900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483061.369014:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.369372:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1875360098687744:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483061.369407:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.369427:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8c00, rc 0) 00000100:00100000:0.0:1788483061.369483:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11351:x1875360087071616:12345-192.168.206.54@tcp:101:bash.0 Request processed in 5779us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.369501:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:3.0:1788483061.369673:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087071744 00000100:00100000:3.0:1788483061.369680:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087071744 00010000:00010000:3.0:1788483061.369711:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 7 pid: 8551 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483061.369746:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:3.0:1788483061.369755:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087071744:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483061.369777:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483061.369796:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 7 pid: 8551 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.369808:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 7 pid: 8551 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.370397:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e36b expref: 7 pid: 8551 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.370422:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483061.370426:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483061.370434:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 6 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.370443:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 6 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.370477:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 6 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483061.370491:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efeb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6478:1875360098687872:192.168.206.54@tcp:105: 00000100:00100000:3.0:1788483061.370548:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483061.376955:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efeb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6478:1875360098687872:192.168.206.54@tcp:105: 00010000:00010000:3.0:1788483061.376981:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483061.379255:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087071744:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 9491us (10239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.379268:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:1.0:1788483061.381328:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.381484:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087072000 00000100:00100000:2.0:1788483061.381494:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087072000 00000100:00100000:2.0:1788483061.381698:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:2.0:1788483061.381710:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:11351:x1875360087072000:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:2.0:1788483061.382588:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:11351:x1875360087072000:12345-192.168.206.54@tcp:35:bash.0 Request processed in 878us (1265us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788483061.382598:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:1.0:1788483061.497303:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483061.497325:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098688000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483061.497401:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483061.497927:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483061.497960:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098688128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483061.498193:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483061.498232:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098688256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483061.498267:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483061.498315:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098688000 00000100:00100000:1.0:1788483061.498322:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098688000 00000100:00100000:1.0:1788483061.498374:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098688256 00000100:00100000:1.0:1788483061.498377:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098688256 00000100:00100000:1.0:1788483061.498396:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788483061.498405:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098688000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788483061.498452:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483061.498498:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098688000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483061.498507:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788483061.498526:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788483061.498533:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098688256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788483061.498542:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483061.498571:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098688256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483061.498576:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788483061.498595:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483061.498626:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098688256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483061.498654:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1788483061.498659:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1788483061.498673:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a68c3cc4700, transno 4294967302 00000100:00100000:1.0:1788483061.498685:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098688000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483061.499521:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483061.500573:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098688128 00000100:00100000:2.0:1788483061.500583:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098688128 00000100:00100000:2.0:1788483061.500630:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788483061.500640:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098688128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483061.500675:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788483061.500864:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098688128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.500871:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788483061.500969:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098688128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483061.601944:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.602051:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087072128 00000100:00100000:0.0:1788483061.602061:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087072128 00000100:00100000:0.0:1788483061.602150:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 108 00000100:00100000:0.0:1788483061.602161:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:11367:x1875360087072128:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483061.602183:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483061.602200:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ad17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e379 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.602262:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ad1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.602276:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.602286:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483061.602325:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788483061.602329:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483061.602345:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.602369:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ad17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e379 expref: 40 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.602401:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ad1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e379 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.602410:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483061.602413:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483061.602416:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:0.0:1788483061.602471:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:11367:x1875360087072128:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 313us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.602478:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 108 00000100:00100000:0.0:1788483061.610943:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.611048:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087072384 00000100:00100000:2.0:1788483061.611058:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087072384 00000100:00100000:2.0:1788483061.611160:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 109 00000100:00100000:2.0:1788483061.611171:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:11367:x1875360087072384:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483061.611192:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483061.611212:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ad25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e380 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.611332:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.611347:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.611358:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483061.611369:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788483061.611483:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ad25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e380 expref: 42 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.611502:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e380 expref: 41 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.611511:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68c1c53000) 00010000:00010000:2.0:1788483061.611514:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483061.611517:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0031200, rc 0) 00000100:00100000:2.0:1788483061.611581:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:11367:x1875360087072384:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 412us (646us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788483061.611588:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 109 00000100:00100000:1.0:1788483061.620913:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483061.620960:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.621073:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087072640 00000100:00100000:0.0:1788483061.621083:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087072640 00000100:00100000:0.0:1788483061.621177:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 110 00000100:00100000:0.0:1788483061.621187:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:11367:x1875360087072640:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483061.621209:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483061.621229:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ad3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e387 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.621323:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.621339:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.621350:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483061.621381:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788483061.621477:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ad3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e387 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.621495:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e387 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.621503:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68c1c53000) 00010000:00010000:0.0:1788483061.621505:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788483061.621509:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8a00, rc 0) 00000100:00100000:0.0:1788483061.621556:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:11367:x1875360087072640:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 371us (654us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788483061.621563:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 110 00000100:00100000:2.0:1788483061.625141:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087072768 00000100:00100000:2.0:1788483061.625169:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087072768 00000100:00100000:2.0:1788483061.625233:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:2.0:1788483061.625242:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:2390:x1875360087072768:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483061.625256:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483061.625280:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e380 expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.625299:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68c1c53000) 00010000:00010000:2.0:1788483061.625303:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483061.625359:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:2390:x1875360087072768:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 117us (4397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.625367:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:0.0:1788483061.632712:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.632786:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087072896 00000100:00100000:2.0:1788483061.632796:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087072896 00000100:00100000:2.0:1788483061.632847:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:2.0:1788483061.632867:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087072896:12345-192.168.206.54@tcp:1:lfs.0 00010000:00010000:2.0:1788483061.632907:0:8551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.632927:0:8551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 6 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.632936:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483061.632940:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483061.632945:0:8551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.632992:0:8551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 6 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.633006:0:8551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 6 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483061.633021:0:8551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8551:1875360098688384:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483061.633152:0:8551:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788483061.636038:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483061.636122:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087073024 00000100:00100000:1.0:1788483061.636130:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087073024 00002000:00100000:1.0:1788483061.636175:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a69e03e3800 x1875360087073024/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:567/0 lens 504/0 e 0 to 0 dl 1788483072 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483061.636186:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69e03e3800 with x1875360087073024 ext(0->8) 00010000:00010000:1.0:1788483061.636194:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 7 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.636222:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 7 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483061.636230:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69e03e3800 00000100:00100000:1.0:1788483061.636261:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:1.0:1788483061.636270:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087073024:12345-192.168.206.54@tcp:4:lfs.0 00000100:00100000:2.0:1788483061.636889:0:8551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8551:1875360098688384:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483061.636911:0:8551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483061.637376:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087073024:12345-192.168.206.54@tcp:4:lfs.0 Request processed in 1105us (1355us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788483061.637385:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00002000:00100000:1.0:1788483061.637393:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a69e03e3800 x1875360087073024/t4294967303(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:567/0 lens 504/448 e 0 to 0 dl 1788483072 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483061.637402:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69e03e3800 with x1875360087073024 ext(0->8) 00010000:00010000:1.0:1788483061.637408:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.637421:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483061.637429:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69e03e3800 00000100:00100000:1.0:1788483061.640930:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.641035:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087073152 00000100:00100000:0.0:1788483061.641044:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087073152 00010000:00010000:0.0:1788483061.641084:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.641157:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:0.0:1788483061.641166:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087073152:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483061.641182:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788483061.641198:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788483061.641201:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788483060 00002000:00010000:0.0:1788483061.641204:0:6479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788483060 00002000:00010000:0.0:1788483061.641220:0:6479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788483060 00002000:00010000:0.0:1788483061.641222:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788483061.641230:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.641244:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.641266:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1ad10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e372 expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.641281:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483061.641286:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483061.641292:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.641302:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.641529:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483061.641581:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087073152:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 415us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.641589:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 68 00010000:00010000:3.0:1788483061.647794:0:8551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647814:0:8551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647864:0:8551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647893:0:8551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647902:0:8551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647909:0:8551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0030400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483061.647914:0:8551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647922:0:8551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647943:0:8551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.647952:0:8551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a2429d/0x1d7ea3d89ea1ad4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483061.648242:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087072896:12345-192.168.206.54@tcp:1:lfs.0 Request processed in 15372us (15534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483061.648252:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:1.0:1788483061.654741:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.654813:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087073408 00000100:00100000:3.0:1788483061.654830:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087073408 00000100:00100000:3.0:1788483061.654896:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:3.0:1788483061.654919:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4626450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:11367:x1875360087073408:12345-192.168.206.54@tcp:35:lfs.0 00000004:00010000:3.0:1788483061.654991:0:6497:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e387 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483061.655241:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788483061.655272:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788483061.655576:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1788483061.655612:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.655627:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 46 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.655636:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.655668:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 46 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.655684:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 46 pid: 8434 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483061.655699:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efeb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875360098688512:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483061.655786:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483061.664414:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.664509:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efeb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875360098688512:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483061.664533:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483061.664628:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087073536 00000100:00100000:2.0:1788483061.664635:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087073536 00010000:00010000:2.0:1788483061.664671:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 47 pid: 8434 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483061.664710:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:2.0:1788483061.664720:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+47:2393:x1875360087073536:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483061.664746:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483061.664754:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 47 pid: 8434 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.664766:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 47 pid: 8434 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.664797:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1acfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e364 expref: 47 pid: 8434 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.664812:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68c1c53000) 00010000:00010000:2.0:1788483061.664817:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.664837:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.664844:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.664879:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483061.664941:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+46:2393:x1875360087073536:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 221us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.664949:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 69 00010000:00010000:3.0:1788483061.665059:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.665066:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483061.665196:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788483061.665297:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788483061.665376:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efeb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875360098688640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788483061.665421:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483061.665444:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788483061.666150:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098688640 00000100:00100000:2.0:1788483061.666157:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098688640 00000100:00100000:2.0:1788483061.666204:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788483061.666212:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1875360098688640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788483061.666298:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1875360098688640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.666306:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788483061.666401:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efeb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875360098688640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788483061.666535:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788483061.666594:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efeb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875360098688768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788483061.666627:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483061.666653:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6176cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483061.666998:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098688768 00000100:00100000:0.0:1788483061.667003:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098688768 00000100:00100000:0.0:1788483061.667038:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788483061.667046:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875360098688768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788483061.667199:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6497:x1875360098688768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 154us (570us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788483061.667206:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788483061.667679:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efeb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875360098688768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788483061.667745:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788483061.667787:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.667798:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.667805:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.667811:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483061.667833:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.667842:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.667871:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68c1c53000) 00010000:00010000:3.0:1788483061.667875:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788483061.667880:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.667888:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1ad56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788483061.668211:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788483061.668314:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788483061.668327:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353931230019ns, next at 354931227374ns, rc = 0 00000001:00080000:3.0:1788483061.668334:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788483061.668361:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68c1c53000) 00010000:00010000:3.0:1788483061.668364:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788483061.668372:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e387 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483061.668470:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4626450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+49:11367:x1875360087073408:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 13553us (13751us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788483061.668478:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 26 00000020:00080000:3.0:1788483061.668482:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788483061.674207:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.681213:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087073664 00000100:00100000:2.0:1788483061.681230:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087073664 00000100:00100000:2.0:1788483061.681301:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 111 00000100:00100000:2.0:1788483061.681312:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+49:11367:x1875360087073664:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483061.681357:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483061.681381:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e38e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.681444:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e38e expref: 50 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.681459:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e38e expref: 50 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.681478:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483061.681481:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483061.681485:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0031200, rc 0) 00000100:00100000:2.0:1788483061.681556:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+50:11367:x1875360087073664:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 245us (7356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.681562:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 111 00000100:00100000:0.0:1788483061.684750:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.684846:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087073920 00000100:00100000:2.0:1788483061.684866:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087073920 00000100:00100000:2.0:1788483061.684915:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:2.0:1788483061.684923:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+50:11367:x1875360087073920:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483061.685175:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+51:11367:x1875360087073920:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 252us (431us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788483061.685182:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:1.0:1788483061.799201:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.799302:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087074048 00000100:00100000:0.0:1788483061.799311:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087074048 00000100:00100000:0.0:1788483061.799372:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 112 00000100:00100000:0.0:1788483061.799381:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+51:11377:x1875360087074048:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:0.0:1788483061.799450:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799466:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799479:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799490:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799497:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799503:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799570:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799594:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799601:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483061.799645:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799656:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799661:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799666:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799671:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.799675:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799681:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799691:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483061.799694:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.799697:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799702:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1ad64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799721:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799734:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799739:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799743:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.799746:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799751:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799758:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa500) 00010000:00010000:0.0:1788483061.799761:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.799764:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799769:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1ad6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799778:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799783:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799788:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799798:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.799801:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799807:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799814:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483061.799817:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483061.799830:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.799835:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.799918:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+51:11377:x1875360087074048:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 538us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.799925:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 112 00000100:00100000:0.0:1788483061.841716:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.842007:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087074304 00000100:00100000:2.0:1788483061.842017:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087074304 00000100:00100000:2.0:1788483061.842079:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 113 00000100:00100000:2.0:1788483061.842089:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+51:11380:x1875360087074304:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483061.842162:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483061.842181:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ad79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e395 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842247:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842262:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842273:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842284:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842292:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842299:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842398:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842407:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842415:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483061.842424:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788483061.842497:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842505:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842511:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842518:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483061.842523:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842530:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842541:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483061.842544:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483061.842548:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842555:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1ad80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842567:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842574:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842580:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842585:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483061.842596:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842603:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842611:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa500) 00010000:00010000:2.0:1788483061.842613:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483061.842616:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842622:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1ad87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842653:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1ad79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842667:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.842675:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483061.842677:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483061.842680:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6a00, rc 0) 00000100:00100000:2.0:1788483061.842751:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+53:11380:x1875360087074304:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 663us (1043us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788483061.842758:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 113 00000100:00100000:1.0:1788483061.846518:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.846603:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087074432 00000100:00100000:0.0:1788483061.846612:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087074432 00000100:00100000:0.0:1788483061.846664:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 114 00000100:00100000:0.0:1788483061.846673:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+53:11380:x1875360087074432:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:0.0:1788483061.846748:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846765:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846791:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846916:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846924:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846930:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846936:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483061.846939:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846946:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846956:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483061.846959:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483061.846962:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.846967:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ad9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.847046:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+53:11380:x1875360087074432:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 373us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.847053:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 114 00000100:00100000:1.0:1788483061.849991:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.850123:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087074688 00000100:00100000:2.0:1788483061.850132:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087074688 00000100:00100000:2.0:1788483061.850185:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:2.0:1788483061.850196:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+53:11380:x1875360087074688:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483061.850415:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11380:x1875360087074688:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 220us (430us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788483061.850422:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00010000:00010000:3.0:1788483061.881407:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483061.948813:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.948921:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087074944 00000100:00100000:0.0:1788483061.948944:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087074944 00000100:00100000:0.0:1788483061.948994:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 115 00000100:00100000:0.0:1788483061.949004:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11390:x1875360087074944:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483061.949024:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483061.949028:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788483061.949051:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1ad1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e379 expref: 54 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.949069:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483061.949074:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483061.949086:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ada3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e39c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.949225:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.949239:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.949248:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.949283:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.949297:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 54 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.949320:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098688896:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483061.949408:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1c30780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483061.952760:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098688896:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483061.952789:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483061.955346:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.955431:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087075072 00000100:00100000:0.0:1788483061.955441:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087075072 00010000:00010000:0.0:1788483061.955480:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 55 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.955520:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:0.0:1788483061.955529:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+55:2392:x1875360087075072:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483061.955542:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483061.955548:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 55 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.955561:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 55 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.955581:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ad8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e395 expref: 55 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.955596:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483061.955602:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.955611:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.955635:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.955673:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483061.955738:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:2392:x1875360087075072:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 210us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483061.955744:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 70 00010000:00010000:1.0:1788483061.956153:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.956161:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483061.956179:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788483061.956312:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1ada3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.956329:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.956336:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483061.956339:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788483061.956342:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8800, rc 0) 00000100:00100000:1.0:1788483061.956380:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11390:x1875360087074944:12345-192.168.206.54@tcp:101:bash.0 Request processed in 7377us (7585us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788483061.956386:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 115 00000100:00100000:2.0:1788483061.961531:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.961770:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087075200 00000100:00100000:3.0:1788483061.961783:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087075200 00000100:00100000:3.0:1788483061.962042:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 116 00000100:00100000:3.0:1788483061.962052:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:11390:x1875360087075200:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:3.0:1788483061.962074:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483061.962293:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1adb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3a3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.962407:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.962424:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.962437:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.962567:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1adb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 56 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.962587:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.962597:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:3.0:1788483061.962599:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483061.962603:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529800, rc 0) 00000100:00100000:3.0:1788483061.962758:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+55:11390:x1875360087075200:12345-192.168.206.54@tcp:101:bash.0 Request processed in 706us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483061.962765:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 116 00000100:00100000:0.0:1788483061.968787:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483061.969047:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087075456 00000100:00100000:3.0:1788483061.969056:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087075456 00000100:00100000:3.0:1788483061.969197:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 117 00000100:00100000:3.0:1788483061.969207:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+55:11390:x1875360087075456:12345-192.168.206.54@tcp:36:bash.0 00010000:00010000:3.0:1788483061.969449:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.969466:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.969476:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483061.969516:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788483061.969537:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e7727bd reply state 00000000aa95837a transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.969549:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483061.969556:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:3.0:1788483061.969559:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483061.969562:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483061.969649:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:11390:x1875360087075456:12345-192.168.206.54@tcp:36:bash.0 Request processed in 442us (868us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788483061.969656:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 117 00000020:00080000:3.0:1788483061.969661:0:8434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788483061.973074:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483061.973235:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087075584 00000100:00100000:0.0:1788483061.973244:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087075584 00000100:00100000:0.0:1788483061.973298:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 118 00000100:00100000:0.0:1788483061.973308:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:11390:x1875360087075584:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483061.973341:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483061.973361:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1adcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3aa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.973446:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.973459:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.973468:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.973499:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483061.973531:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 59 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483061.973545:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098689024:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483061.973612:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1c30780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483061.977474:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.977545:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087075712 00000100:00100000:2.0:1788483061.977555:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087075712 00010000:00010000:2.0:1788483061.977598:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 60 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483061.977665:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:2.0:1788483061.977674:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:2393:x1875360087075712:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483061.977687:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483061.977694:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 60 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.977706:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 60 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.977736:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483061.977740:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.977749:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.977773:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483061.977791:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483061.977861:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:2393:x1875360087075712:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 188us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483061.977868:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 71 00010000:00010000:1.0:1788483061.978322:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1adaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e39c expref: 59 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483061.978339:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098689024:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483061.978361:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.978369:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.978384:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483061.978445:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788483061.978450:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483061.978469:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.978496:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1adcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 59 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.978637:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 58 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483061.978645:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483061.978648:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483061.978651:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9c00, rc 0) 00000100:00100000:1.0:1788483061.978694:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:11390:x1875360087075584:12345-192.168.206.54@tcp:101:bash.0 Request processed in 5387us (5628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483061.978701:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 118 00000100:00100000:0.0:1788483061.982045:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483061.982175:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087075968 00000100:00100000:2.0:1788483061.982185:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087075968 00000100:00100000:2.0:1788483061.982232:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:2.0:1788483061.982241:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:11390:x1875360087075968:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:2.0:1788483061.982497:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+59:11390:x1875360087075968:12345-192.168.206.54@tcp:35:bash.0 Request processed in 256us (459us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788483061.982577:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:1.0:1788483062.049655:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.049828:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087076096 00000100:00100000:3.0:1788483062.049838:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087076096 00000100:00100000:3.0:1788483062.049966:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 119 00000100:00100000:3.0:1788483062.049986:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+59:11396:x1875360087076096:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483062.050009:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483062.050039:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1addb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3b1 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.050136:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ade2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.050151:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ade2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.050162:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ade2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483062.050364:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788483062.050369:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483062.050388:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ade2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.050412:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1addb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3b1 expref: 61 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.050433:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ade2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3b1 expref: 60 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.050441:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483062.050444:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483062.050454:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528000, rc 0) 00000100:00100000:2.0:1788483062.050518:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:11396:x1875360087076096:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 533us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.050525:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 119 00000100:00100000:3.0:1788483062.053193:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.053276:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087076224 00000100:00100000:2.0:1788483062.053285:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087076224 00000100:00100000:2.0:1788483062.053333:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 120 00000100:00100000:2.0:1788483062.053342:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:11396:x1875360087076224:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483062.053359:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483062.053377:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ade9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3b8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053436:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053448:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053458:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053467:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053473:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053479:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053543:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1adfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053563:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1adfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053570:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1adfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483062.053605:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788483062.053610:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483062.053627:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1adfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053638:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1adfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053647:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053653:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053659:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053665:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483062.053669:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053675:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053686:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483062.053689:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483062.053700:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053707:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1adf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053722:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053729:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053735:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053740:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483062.053743:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053748:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053757:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa500) 00010000:00010000:2.0:1788483062.053759:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483062.053762:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053767:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1adf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053794:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ade9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3b8 expref: 62 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053833:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1adfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3b8 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.053841:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483062.053843:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483062.053846:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6200, rc 0) 00000100:00100000:2.0:1788483062.053921:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11396:x1875360087076224:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 579us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.053928:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 120 00000100:00080000:1.0:1788483062.056111:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483062.060894:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.060940:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.061020:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087076608 00000100:00100000:2.0:1788483062.061029:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087076608 00000100:00100000:2.0:1788483062.061092:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:2.0:1788483062.061144:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:2392:x1875360087076608:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483062.061160:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483062.061183:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1adfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3b8 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.061200:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483062.061205:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483062.061251:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:2392:x1875360087076608:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.061258:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:1.0:1788483062.061644:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087076480 00000100:00100000:1.0:1788483062.061649:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087076480 00000100:00100000:1.0:1788483062.061687:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 121 00000100:00100000:1.0:1788483062.061694:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:11396:x1875360087076480:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:1.0:1788483062.061708:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483062.061734:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1ae05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.061834:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.061857:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.061865:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.061894:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.061905:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 61 pid: 6495 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483062.061918:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098689152:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483062.062024:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e038e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483062.069980:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098689152:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483062.070010:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.071372:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.071661:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087076736 00000100:00100000:1.0:1788483062.071669:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087076736 00010000:00010000:1.0:1788483062.071706:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 62 pid: 6495 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483062.071775:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 72 00000100:00100000:1.0:1788483062.071784:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:2392:x1875360087076736:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483062.071798:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483062.071804:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 62 pid: 6495 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.071825:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 62 pid: 6495 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.071857:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1add4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3aa expref: 62 pid: 6495 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.071873:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483062.071878:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.071887:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.071894:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.075207:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483062.075288:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:2392:x1875360087076736:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 3499us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483062.075300:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 72 00010000:00010000:0.0:1788483062.078505:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.078522:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483062.078543:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788483062.078678:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1ae05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.078698:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.078708:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483062.078711:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788483062.078714:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27800, rc 0) 00000100:00100000:0.0:1788483062.080004:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11396:x1875360087076480:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 18304us (19112us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788483062.080026:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 121 00000100:00100000:0.0:1788483062.083582:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.083656:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087076992 00000100:00100000:2.0:1788483062.083665:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087076992 00000100:00100000:2.0:1788483062.083982:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:2.0:1788483062.083994:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11396:x1875360087076992:12345-192.168.206.54@tcp:103:lfs.0 00010000:00010000:2.0:1788483062.084025:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483062.084050:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1ad5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e38e expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.084070:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483062.084074:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483062.084206:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:11396:x1875360087076992:12345-192.168.206.54@tcp:103:lfs.0 Request processed in 214us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.084214:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:3.0:1788483062.086361:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.086531:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087077120 00000100:00100000:0.0:1788483062.086541:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087077120 00000100:00100000:0.0:1788483062.086647:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 122 00000100:00100000:0.0:1788483062.086659:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:11396:x1875360087077120:12345-192.168.206.54@tcp:58:lfs.0 00010000:00010000:0.0:1788483062.086772:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.086788:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.086799:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483062.086911:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788483062.087003:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:11396:x1875360087077120:12345-192.168.206.54@tcp:58:lfs.0 Request processed in 345us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.087009:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 122 00000100:00100000:3.0:1788483062.089497:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.089901:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087077248 00000100:00100000:1.0:1788483062.089928:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087077248 00000100:00100000:0.0:1788483062.089998:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:0.0:1788483062.090008:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:11396:x1875360087077248:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483062.090028:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483062.090049:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3c6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.090129:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.090149:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.090167:0:6494:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.090179:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.090192:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483062.090194:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483062.090198:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.090205:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9600, rc 0) 00000100:00100000:0.0:1788483062.090250:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11396:x1875360087077248:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 243us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.090257:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 123 00000040:00080000:1.0:1788483062.648344:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483062.648352:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483062.648376:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788483062.648386:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483062.648507:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098689280:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788483062.648668:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e038e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788483062.651311:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098689280:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788483062.652328:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.652414:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087077376 00000100:00100000:2.0:1788483062.652422:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087077376 00000100:00100000:2.0:1788483062.652479:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 124 00000100:00100000:2.0:1788483062.652489:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11397:x1875360087077376:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788483062.652516:0:8434:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788483062.652640:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11397:x1875360087077376:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 151us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.652647:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 124 00000100:00100000:3.0:1788483062.663067:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.663265:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087077504 00000100:00100000:0.0:1788483062.663275:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087077504 00000100:00100000:0.0:1788483062.663333:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 125 00000100:00100000:0.0:1788483062.663345:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11397:x1875360087077504:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788483062.663413:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663428:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663455:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663470:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663477:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663482:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663504:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663513:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663519:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483062.663562:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788483062.663566:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483062.663578:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663588:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663594:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663610:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663615:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.663619:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663626:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663637:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:0.0:1788483062.663640:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483062.663644:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663650:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1ae28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663662:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663668:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663673:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663677:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.663680:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663694:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663701:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9a68c3183f00) 00010000:00010000:0.0:1788483062.663703:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483062.663706:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663711:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663724:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663729:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663734:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663738:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.663741:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663746:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663752:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483062.663754:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483062.663757:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.663771:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.663915:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11397:x1875360087077504:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 Request processed in 571us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.663923:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 125 00000100:00100000:3.0:1788483062.666372:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.666452:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087077760 00000100:00100000:2.0:1788483062.666462:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087077760 00000100:00100000:2.0:1788483062.666524:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 126 00000100:00100000:2.0:1788483062.666534:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:11397:x1875360087077760:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483062.666553:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483062.666575:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ae3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3cd expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666672:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666697:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666708:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483062.666718:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788483062.666788:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666796:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666802:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666808:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483062.666812:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666831:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666843:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483062.666853:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788483062.666857:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666863:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666902:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ae3d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3cd expref: 63 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666918:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:2.0:1788483062.666921:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483062.666924:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ae3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3cd expref: 63 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.666934:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6a00, rc 0) 00000100:00100000:2.0:1788483062.666985:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:11397:x1875360087077760:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 453us (621us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788483062.667000:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 126 00000100:00100000:3.0:1788483062.675346:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.675428:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087077888 00000100:00100000:0.0:1788483062.675438:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087077888 00000100:00100000:0.0:1788483062.675493:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:0.0:1788483062.675503:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:11397:x1875360087077888:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788483062.675536:0:6494:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788483062.675642:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:11397:x1875360087077888:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 139us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.675649:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:3.0:1788483062.684196:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.684309:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087078144 00000100:00100000:2.0:1788483062.684319:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087078144 00000100:00100000:2.0:1788483062.684375:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 128 00000100:00100000:2.0:1788483062.684386:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:11397:x1875360087078144:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483062.684403:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483062.684406:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788483062.684431:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1ade2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3b1 expref: 62 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.684451:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:2.0:1788483062.684455:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483062.684466:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ae52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3d4 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788483062.684788:0:8434:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788483062.684936:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.684959:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.684969:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.685021:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ae52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3d4 expref: 64 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.685037:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3d4 expref: 63 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.685044:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32faf00) 00010000:00010000:2.0:1788483062.685046:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483062.685049:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6400, rc 0) 00000100:00100000:2.0:1788483062.685162:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+63:11397:x1875360087078144:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 776us (973us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788483062.685170:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 128 00000100:00100000:3.0:1788483062.694663:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.694772:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087078400 00000100:00100000:0.0:1788483062.694781:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087078400 00000100:00100000:0.0:1788483062.694861:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 129 00000100:00100000:0.0:1788483062.694872:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+63:11397:x1875360087078400:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788483062.694923:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483062.694948:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1ae59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3d4 expref: 63 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.694967:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32faf00) 00010000:00010000:0.0:1788483062.694976:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483062.695008:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695032:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695041:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695158:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695167:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695174:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695224:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695231:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695238:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695243:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.695247:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695255:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695264:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:0.0:1788483062.695272:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483062.695276:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695282:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1ae67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695293:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695299:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695304:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695309:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.695312:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695317:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695325:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x22f5cc9c (ffff9a68c3183f00) 00010000:00010000:0.0:1788483062.695327:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483062.695330:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.695335:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x22f5cc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.695417:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:11397:x1875360087078400:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 546us (761us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788483062.695429:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 129 00000100:00100000:3.0:1788483062.700633:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.700725:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087078528 00000100:00100000:2.0:1788483062.700735:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087078528 00000100:00100000:2.0:1788483062.700807:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 130 00000100:00100000:2.0:1788483062.700827:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:11397:x1875360087078528:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483062.700853:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483062.700878:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ae75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3db expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.700915:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.700943:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.700956:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.701074:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1ae75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 64 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.701089:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 63 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.701137:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:2.0:1788483062.701140:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483062.701143:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c7200, rc 0) 00000100:00100000:2.0:1788483062.701192:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+63:11397:x1875360087078528:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 377us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.701199:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 130 00000100:00100000:3.0:1788483062.707240:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.707463:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087078784 00000100:00100000:0.0:1788483062.707473:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087078784 00000100:00100000:0.0:1788483062.707525:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:0.0:1788483062.707536:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+63:11397:x1875360087078784:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788483062.707617:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.707636:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.707649:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483062.707817:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788483062.707827:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354970730482ns, next at 355970728067ns, rc = 0 00000004:00010000:0.0:1788483062.707896:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f4da215 reply state 000000009a0a2d65 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.707911:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.707921:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:0.0:1788483062.707923:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788483062.707926:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788483062.708028:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:11397:x1875360087078784:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 490us (796us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788483062.708037:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:2.0:1788483062.713270:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.713341:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087078912 00000100:00100000:3.0:1788483062.713352:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087078912 00000100:00100000:3.0:1788483062.713415:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:3.0:1788483062.713424:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:11397:x1875360087078912:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483062.713448:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483062.713468:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3e2 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.713539:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 66 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.713552:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 66 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.713570:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:3.0:1788483062.713572:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483062.713576:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529400, rc 0) 00000100:00100000:3.0:1788483062.717786:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:11397:x1875360087078912:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 4351us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.717800:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:0.0:1788483062.723693:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.723927:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087079040 00000100:00100000:1.0:1788483062.723936:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087079040 00000100:00100000:1.0:1788483062.724029:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:1.0:1788483062.724039:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087079040:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788483062.724302:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087079040:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 263us (618us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788483062.724311:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00080000:3.0:1788483062.724927:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483062.728199:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.728283:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087079296 00000100:00100000:3.0:1788483062.728292:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087079296 00000100:00100000:3.0:1788483062.728350:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:3.0:1788483062.728360:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:11397:x1875360087079296:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788483062.728571:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:11397:x1875360087079296:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 211us (379us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788483062.728581:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:2.0:1788483062.731036:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.731144:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087079552 00000100:00100000:0.0:1788483062.731153:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087079552 00000100:00100000:0.0:1788483062.731205:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 133 00000100:00100000:0.0:1788483062.731215:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:11397:x1875360087079552:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483062.731314:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:11397:x1875360087079552:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 100us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.731322:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 133 00000100:00100000:0.0:1788483062.733690:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.736072:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087079680 00000100:00100000:1.0:1788483062.736087:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087079680 00000100:00100000:1.0:1788483062.736204:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 134 00000100:00100000:1.0:1788483062.736217:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:11397:x1875360087079680:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483062.736237:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483062.736258:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ae91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3e9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.736320:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ae98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.736350:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.736360:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483062.736401:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483062.736419:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.736444:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1ae91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e9 expref: 69 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.736462:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ae98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e9 expref: 68 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.736470:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:1.0:1788483062.736473:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788483062.736476:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26c00, rc 0) 00000100:00100000:1.0:1788483062.736542:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:11397:x1875360087079680:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 328us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483062.736549:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 134 00000100:00100000:1.0:1788483062.740961:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.741031:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087079808 00000100:00100000:0.0:1788483062.741040:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087079808 00000100:00100000:0.0:1788483062.741115:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:0.0:1788483062.741127:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2393:x1875360087079808:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483062.741145:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483062.741167:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3f0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483062.741204:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a15f5, blocks: 0x0 00010000:00010000:0.0:1788483062.741227:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788483062.741233:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483062.741244:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.741266:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.741280:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8600, rc 0) 00000100:00100000:0.0:1788483062.741371:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:2393:x1875360087079808:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 247us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.741378:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:2.0:1788483062.747304:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.747379:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087080064 00000100:00100000:0.0:1788483062.747390:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087080064 00000100:00100000:0.0:1788483062.747449:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 135 00000100:00100000:0.0:1788483062.747459:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:11397:x1875360087080064:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483062.747572:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:11397:x1875360087080064:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.747578:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 135 00000100:00100000:3.0:1788483062.750487:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.750567:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087080192 00000100:00100000:1.0:1788483062.750575:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087080192 00000100:00100000:1.0:1788483062.750629:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:1.0:1788483062.750639:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:11397:x1875360087080192:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483062.750655:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483062.750682:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3f7 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.750710:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.750718:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483062.750722:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483062.750726:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.750932:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.750947:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 11 pid: 8409 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483062.750960:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1875360098689408:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483062.751133:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e038e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788483062.759030:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.759131:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087080320 00000100:00100000:0.0:1788483062.759141:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087080320 00010000:00010000:0.0:1788483062.759195:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 12 pid: 8409 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.759236:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 73 00000100:00100000:0.0:1788483062.759246:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:2393:x1875360087080320:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483062.759261:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483062.759284:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 12 pid: 8409 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.759303:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 12 pid: 8409 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.759326:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483062.759330:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483062.759353:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 12 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.759363:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 12 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.759402:0:7436:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 12 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.759414:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7436:1875360098689536:192.168.206.54@tcp:105: 00000100:00100000:0.0:1788483062.759484:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c35f7540 going to sleep for 11 seconds 00010000:00010000:3.0:1788483062.759611:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1ae9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f0 expref: 12 pid: 8409 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.759627:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1875360098689408:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483062.759659:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.759668:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26200, rc 0) 00000100:00100000:3.0:1788483062.759698:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:11397:x1875360087080192:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 9060us (9218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.759705:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:2.0:1788483062.768199:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.768371:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087080448 00000100:00100000:1.0:1788483062.768379:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087080448 00002000:00100000:1.0:1788483062.768419:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a68c3ec6300 x1875360087080448/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:568/0 lens 504/0 e 0 to 0 dl 1788483073 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483062.768430:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c3ec6300 with x1875360087080448 ext(0->12) 00002000:00010000:1.0:1788483062.768435:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68c3ec6300 00000100:00100000:1.0:1788483062.768478:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:1.0:1788483062.768486:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:2393:x1875360087080448:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788483062.769382:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7436:1875360098689536:192.168.206.54@tcp:105: 00010000:00010000:0.0:1788483062.769403:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483062.769449:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:2393:x1875360087080320:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 10205us (10429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.769458:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 73 00000100:00100000:2.0:1788483062.770422:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:2393:x1875360087080448:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 Request processed in 1930us (2236us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788483062.770437:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00002000:00100000:2.0:1788483062.770447:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a68c3ec6300 x1875360087080448/t4294967309(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:568/0 lens 504/448 e 0 to 0 dl 1788483073 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483062.770475:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c3ec6300 with x1875360087080448 ext(0->12) 00002000:00010000:2.0:1788483062.770480:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68c3ec6300 00000100:00100000:2.0:1788483062.776018:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.776331:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087080576 00000100:00100000:1.0:1788483062.776341:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087080576 00000100:00100000:1.0:1788483062.776399:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 136 00000100:00100000:1.0:1788483062.776409:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:11397:x1875360087080576:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788483062.779434:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788483062.779452:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788483062.779487:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788483062.779511:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a69ed97a900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788483062.779516:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69c2d28900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a69cb3d9240 00000020:00080000:1.0:1788483062.779520:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69c2d78d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c364a400 00000004:00080000:1.0:1788483062.779547:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788483062.779570:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a69ed97a6c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788483062.779574:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69d9bfb600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a69ed97a600 00000020:00080000:1.0:1788483062.779577:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69d9bfbd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a69c3acf800 00000020:00080000:1.0:1788483062.779600:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788483062.779700:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788483062.779837:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11397:x1875360087080576:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 Request processed in 3425us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483062.779856:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 136 00010000:00010000:3.0:1788483062.780250:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780261:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780267:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780273:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483062.780277:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780283:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780299:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a69df303200) 00010000:00010000:3.0:1788483062.780302:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483062.780306:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780312:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1abab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780350:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780356:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780361:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780365:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483062.780368:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780374:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780382:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68c3183c00) 00010000:00010000:3.0:1788483062.780384:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483062.780386:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780391:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1ac53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780405:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780411:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780416:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780427:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483062.780429:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780434:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780442:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa500) 00010000:00010000:3.0:1788483062.780444:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483062.780447:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780452:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1acd1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780463:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780469:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780475:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780479:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483062.780482:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780488:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780507:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a69c32fa500) 00010000:00010000:3.0:1788483062.780510:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483062.780512:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780517:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1acf4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780533:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780540:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780545:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780549:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483062.780552:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780557:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780564:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:3.0:1788483062.780566:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483062.780569:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780574:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1adc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780596:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780601:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780607:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780611:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483062.780614:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780619:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780627:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:3.0:1788483062.780629:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788483062.780632:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.780637:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1ae83 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.781621:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483062.781639:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098689664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788483062.781700:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483062.781743:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098689664 00000100:00100000:0.0:1788483062.781750:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098689664 00000100:00100000:0.0:1788483062.781790:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788483062.781799:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098689664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788483062.781834:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1788483062.781871:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a15f4, atime: 0x6a9a15f4, ctime: 0x6a9a15f4, blocks: 0x8 00010000:00010000:0.0:1788483062.781877:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.781902:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788483062.781906:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483062.781913:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.781928:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.781938:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.781945:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.781963:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788483062.782165:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098689664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 366us (464us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788483062.782172:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1788483062.782207:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483062.782213:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.782221:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483062.782225:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.782245:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.782260:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.782268:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1aead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.782285:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483062.782287:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483062.782290:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788483062.782321:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a68c3da7800/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788483062.782329:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098689664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788483062.782355:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098689792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788483062.782383:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483062.782409:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483062.782414:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098689920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788483062.782436:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483062.782451:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098689792 00000100:00100000:2.0:1788483062.782527:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098689792 00000100:00100000:3.0:1788483062.782574:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098689920 00000100:00100000:3.0:1788483062.782580:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098689920 00000100:00100000:2.0:1788483062.782581:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788483062.782592:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098689792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788483062.782608:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00100000:3.0:1788483062.782613:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788483062.782622:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098689920:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788483062.782632:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.782649:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.782657:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788483062.782660:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483062.782664:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.782691:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483062.782705:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:2.0:1788483062.782705:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 11 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483062.782712:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788483062 00002000:00010000:3.0:1788483062.782723:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788483062.782728:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788483061 -> 1788483062 00002000:00010000:3.0:1788483062.782731:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788483062.782750:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098690048:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483062.782766:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3621:x1875360098689920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (329us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788483062.782774:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788483062.782801:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a68c3ec5180/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788483062.782807:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098689920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788483062.782992:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7180 going to sleep for 11 seconds 00000100:00080000:0.0:1788483062.783327:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483062.788019:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.788123:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087080704 00000100:00100000:3.0:1788483062.788135:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087080704 00000100:00100000:3.0:1788483062.788182:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:3.0:1788483062.788192:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:2392:x1875360087080704:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788483062.790356:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788483062.790367:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788483062.792054:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087080704:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 Request processed in 3855us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.792067:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:0.0:1788483062.800193:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.800828:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087080832 00000100:00100000:3.0:1788483062.800835:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087080832 00010000:00010000:3.0:1788483062.800881:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 7 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.800920:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 74 00000100:00100000:3.0:1788483062.800929:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087080832:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483062.800943:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483062.800949:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 7 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.800990:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 7 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.801011:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1ac61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e34f expref: 7 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.801028:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483062.801033:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483062.801037:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.801046:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.801066:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483062.801465:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098690048:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483062.801488:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.801499:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.801506:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.801526:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.801535:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.801557:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788483062.802050:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098689792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19135us (19341us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788483062.802059:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1788483062.802198:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483062.802206:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.802226:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483062.802231:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.802241:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.802257:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.802264:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1aeb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.802284:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483062.802286:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483062.802287:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483062.802457:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087080832:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 1526us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.802466:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 74 00000100:00100000:3.0:1788483062.802512:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788483062.802529:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788483062.802546:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a68c3ec5180, transno 4294967310 00000100:00100000:3.0:1788483062.802563:0:3621:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a68c3ec5880 x1875360098689792/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788483078 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788483062.802573:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a68c3ec5880/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788483062.802578:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098689792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788483062.803147:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.804650:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087081088 00000100:00100000:2.0:1788483062.804675:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087081088 00000100:00100000:2.0:1788483062.804896:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:2.0:1788483062.804908:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:11397:x1875360087081088:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483062.804958:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483062.805089:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1ae98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e9 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.805161:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:2.0:1788483062.805166:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483062.805265:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.805278:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.805288:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483062.805617:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006854ea25 reply state 00000000c79f7730 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.805630:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.805637:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:2.0:1788483062.805640:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483062.805643:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483062.805800:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:11397:x1875360087081088:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 893us (2653us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788483062.805808:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:0.0:1788483062.810406:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.810487:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087081216 00000100:00100000:3.0:1788483062.810498:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087081216 00000100:00100000:3.0:1788483062.810681:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:3.0:1788483062.810691:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087081216:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788483062.811684:0:8551:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788483062.811690:0:8551:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788483062 -> 1788483061 00002000:00010000:3.0:1788483062.811693:0:8551:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788483060 00002000:00010000:3.0:1788483062.811696:0:8551:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788483062 -> 1788483061 00002000:00010000:3.0:1788483062.811698:0:8551:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788483062.811806:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087081216:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 1113us (1405us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788483062.811824:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:0.0:1788483062.815297:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.815381:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087081472 00000100:00100000:3.0:1788483062.815390:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087081472 00000100:00100000:3.0:1788483062.815447:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00100000:3.0:1788483062.815457:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:11397:x1875360087081472:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788483062.815609:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.815627:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 17 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.815636:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.815670:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 17 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.815700:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 17 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.815713:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098690176:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483062.815797:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c61766c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483062.820659:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.820766:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087081600 00000100:00100000:1.0:1788483062.820775:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087081600 00010000:00010000:1.0:1788483062.820812:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 18 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483062.820866:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 75 00000100:00100000:1.0:1788483062.820875:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:2392:x1875360087081600:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483062.820887:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483062.820894:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 18 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.820911:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 18 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.820932:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:1.0:1788483062.820936:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.820945:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.820951:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.820967:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483062.821018:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:2392:x1875360087081600:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 144us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483062.821024:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 75 00010000:00010000:3.0:1788483062.821691:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1ae7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3db expref: 17 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.821708:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098690176:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483062.821739:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821748:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821754:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821788:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821795:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821801:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821806:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483062.821828:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821835:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821853:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:3.0:1788483062.821856:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788483062.821860:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.821867:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1aec2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.821921:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:11397:x1875360087081472:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 Request processed in 6465us (6630us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788483062.821929:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00100000:0.0:1788483062.826317:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.826473:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087081728 00000100:00100000:3.0:1788483062.826483:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087081728 00000100:00100000:3.0:1788483062.826538:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:3.0:1788483062.826548:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087081728:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788483062.826590:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.826609:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.826617:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483062.826621:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483062.826638:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.826672:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.826685:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 7 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.826699:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1875360098690304:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483062.826871:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c61766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483062.829789:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1875360098690304:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483062.830203:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.834226:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.834279:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087081856 00000100:00100000:1.0:1788483062.834288:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087081856 00010000:00010000:1.0:1788483062.834329:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 8 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483062.834432:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 76 00000100:00100000:1.0:1788483062.834442:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087081856:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483062.834458:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483062.834479:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 8 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.834512:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 8 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.834535:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1aea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3f7 expref: 8 pid: 8411 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.834551:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483062.834556:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483062.834561:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.834570:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.834602:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483062.834655:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087081856:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 213us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483062.834663:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 76 00010000:00010000:3.0:1788483062.834906:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.834916:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.834940:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.834949:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.834985:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.834992:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483062.834996:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.835003:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.835016:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.835023:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1aec9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.835070:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087081728:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 Request processed in 8523us (8760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.835077:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:1.0:1788483062.844953:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.845165:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087082112 00000100:00100000:0.0:1788483062.845174:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087082112 00000100:00100000:0.0:1788483062.845240:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 139 00000100:00100000:0.0:1788483062.845250:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:11397:x1875360087082112:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788483062.845332:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.845349:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.845360:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.845396:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.845410:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 16 pid: 6494 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.845424:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098690432:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483062.845512:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1c30480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483062.853248:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098690432:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483062.853261:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00010000:00010000:2.0:1788483062.853292:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.855400:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087082240 00000100:00100000:0.0:1788483062.855413:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087082240 00010000:00010000:0.0:1788483062.855459:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 17 pid: 6494 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.855513:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 77 00000100:00100000:0.0:1788483062.855536:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:2393:x1875360087082240:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483062.855551:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483062.855572:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 17 pid: 6494 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.855585:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 17 pid: 6494 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.855606:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1adbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3a3 expref: 17 pid: 6494 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.855632:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483062.855638:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.855648:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.855656:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.855664:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.855907:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483062.855967:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:2393:x1875360087082240:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 432us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.855974:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 77 00010000:00010000:2.0:1788483062.859063:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.859080:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.863275:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.863315:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 16 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.863324:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.863382:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 16 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.863401:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 16 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483062.863420:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098690560:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483062.864223:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483062.874243:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.874293:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098690560:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483062.874323:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.875017:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087082368 00000100:00100000:3.0:1788483062.875025:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087082368 00010000:00010000:3.0:1788483062.875070:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 17 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.875148:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 78 00000100:00100000:3.0:1788483062.875166:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:2392:x1875360087082368:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483062.875181:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483062.875188:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 17 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.875200:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 17 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.875219:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1ae8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3e2 expref: 17 pid: 8434 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.875234:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:3.0:1788483062.875238:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.875247:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.875254:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.875282:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483062.875326:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483062.875331:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:2392:x1875360087082368:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 164us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.875343:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 78 00010000:00010000:2.0:1788483062.875343:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483062.875444:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788483062.875577:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788483062.875620:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788483062.875693:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098690688:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788483062.875757:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483062.875792:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788483062.876459:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098690688 00000100:00100000:1.0:1788483062.876465:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098690688 00000100:00100000:1.0:1788483062.876507:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788483062.876517:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6493:x1875360098690688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788483062.876638:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6493:x1875360098690688:12345-0@lo:1000:mdt00_000.0 Request processed in 123us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483062.876645:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788483062.877787:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098690688:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788483062.877959:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788483062.878032:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098690816:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788483062.878076:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483062.878134:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483062.878141:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098690816 00000100:00100000:3.0:1788483062.878149:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098690816 00000100:00100000:3.0:1788483062.878184:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788483062.878192:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6493:x1875360098690816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788483062.878314:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6493:x1875360098690816:12345-0@lo:1000:mdt00_000.0 Request processed in 123us (237us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788483062.878321:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788483062.878498:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098690816:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788483062.878535:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878651:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878660:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878666:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.878671:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878679:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878696:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:0.0:1788483062.878699:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483062.878704:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878710:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1aed7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878734:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878748:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878753:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878759:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.878762:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878768:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878777:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483062.878779:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483062.878785:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878796:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878804:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.878831:0:6493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.878841:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098690944:192.168.206.54@tcp:105: 00000100:00100000:0.0:1788483062.878924:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483062.883980:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.884041:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087082496 00000100:00100000:3.0:1788483062.884051:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087082496 00000100:00100000:3.0:1788483062.884135:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:3.0:1788483062.884145:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11396:x1875360087082496:12345-192.168.206.54@tcp:49:lfs.0 00000100:00100000:3.0:1788483062.884258:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:11396:x1875360087082496:12345-192.168.206.54@tcp:49:lfs.0 Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.884265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:0.0:1788483062.886273:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098690944:192.168.206.54@tcp:105: 00010000:00010000:0.0:1788483062.886299:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886308:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1ae1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886337:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886349:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886359:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886369:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886374:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886380:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886386:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.886389:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886395:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886423:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483062.886426:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483062.886429:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886435:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aede lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886443:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886448:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886453:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886457:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483062.886460:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886465:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886471:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483062.886473:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483062.886475:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.886480:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aed0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.886660:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11397:x1875360087082112:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 41411us (41721us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788483062.886668:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 139 00000020:00080000:0.0:1788483062.886674:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788483062.886816:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483062.886820:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483062.887363:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788483062.887374:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483062.900198:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483062.900252:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483062.900336:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087083008 00000100:00100000:3.0:1788483062.900346:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087083008 00000100:00100000:3.0:1788483062.900407:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:3.0:1788483062.900416:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4624050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:11397:x1875360087083008:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788483062.900886:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788483062.900917:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1788483062.900947:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.900962:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.900972:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.900980:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.901001:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.901012:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483062.901070:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788483062.901183:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4624050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:11397:x1875360087083008:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 766us (928us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788483062.901190:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 32 00000020:00080000:3.0:1788483062.901195:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788483062.901352:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087082752 00000100:00100000:2.0:1788483062.901358:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087082752 00000100:00100000:2.0:1788483062.901396:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 140 00000100:00100000:2.0:1788483062.901404:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:11396:x1875360087082752:12345-192.168.206.54@tcp:58:lfs.0 00000040:00080000:2.0:1788483062.901497:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788483062.901531:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:11396:x1875360087082752:12345-192.168.206.54@tcp:58:lfs.0 Request processed in 128us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.901537:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 140 00010000:00010000:0.0:1788483062.903349:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483062.903362:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.903374:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483062.903379:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.903389:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.903406:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:0.0:1788483062.903409:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788483062.903413:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.903419:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1aee5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.903512:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483062.903515:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483062.903516:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483062.904372:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483062.928201:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.928239:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.928262:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.928289:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.928323:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.928351:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087083648 00000100:00100000:2.0:1788483062.928359:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087083648 00000100:00100000:2.0:1788483062.928418:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 296 00000100:00100000:2.0:1788483062.928429:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087083648:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483062.928502:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087083648:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.928510:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 296 00000100:00100000:2.0:1788483062.928528:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087083264 00000100:00100000:2.0:1788483062.928531:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087083264 00000100:00100000:2.0:1788483062.928546:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087083520 00000100:00100000:2.0:1788483062.928549:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087083520 00000100:00100000:2.0:1788483062.928566:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 297 00000100:00100000:2.0:1788483062.928572:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087083264:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483062.928597:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087083264:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.928603:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 297 00000100:00100000:2.0:1788483062.928614:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 298 00000100:00100000:2.0:1788483062.928621:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087083520:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483062.928643:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087083520:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.928648:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 298 00000100:00080000:0.0:1788483062.928730:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483062.928735:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788483062.928746:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087083392 00000100:00100000:0.0:1788483062.928750:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087083392 00000100:00100000:0.0:1788483062.928786:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:0.0:1788483062.928793:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087083392:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483062.928841:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087083392:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 49us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483062.928858:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:3.0:1788483062.929478:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087083136 00000100:00100000:3.0:1788483062.929484:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087083136 00000100:00100000:3.0:1788483062.929529:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 385 00000100:00100000:3.0:1788483062.929537:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087083136:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483062.929577:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087083136:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 41us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483062.929583:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 385 00000100:00100000:2.0:1788483062.935453:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483062.935554:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087083776 00000100:00100000:0.0:1788483062.935566:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087083776 00000100:00100000:0.0:1788483062.935628:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 141 00000100:00100000:0.0:1788483062.935638:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:11399:x1875360087083776:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483062.935660:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483062.935681:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aeec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e3fe expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935744:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935757:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935767:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935781:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935788:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935794:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935879:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935902:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935922:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935954:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483062.935976:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 22 pid: 6493 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483062.935990:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098691072:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483062.936076:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483062.939600:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.939705:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087084032 00000100:00100000:2.0:1788483062.939716:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087084032 00000100:00100000:2.0:1788483062.939784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:2.0:1788483062.939796:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:6164:x1875360087084032:12345-192.168.206.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788483062.940087:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:6164:x1875360087084032:12345-192.168.206.54@tcp:35:ldlm_bl.0 Request processed in 292us (494us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788483062.940139:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:0.0:1788483062.942405:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098691072:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483062.942435:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483062.943176:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483062.943307:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087084160 00000100:00100000:2.0:1788483062.943315:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087084160 00010000:00010000:2.0:1788483062.943358:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 24 pid: 6493 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483062.943403:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 79 00000100:00100000:2.0:1788483062.943412:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:2393:x1875360087084160:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483062.943425:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483062.943433:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 24 pid: 6493 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.943446:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 24 pid: 6493 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.943469:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1ae0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3bf expref: 24 pid: 6493 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.943484:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:2.0:1788483062.943490:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.943499:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.943506:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483062.943556:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483062.943613:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:2393:x1875360087084160:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 201us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483062.943620:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 79 00010000:00010000:1.0:1788483062.943679:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943686:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483062.943734:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788483062.943739:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483062.943757:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943771:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943779:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943792:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943799:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943806:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483062.943810:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943829:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943839:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:1.0:1788483062.943851:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483062.943856:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943861:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1aef3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943873:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943879:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943885:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943890:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483062.943900:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943906:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943915:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68c3183700) 00010000:00010000:1.0:1788483062.943918:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483062.943921:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943926:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1aefa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943974:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1aeec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3fe expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943986:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3fe expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483062.943993:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483062.943995:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483062.943998:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9e00, rc 0) 00000100:00100000:1.0:1788483062.944024:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11399:x1875360087083776:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 8388us (8583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483062.944031:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 141 00000040:00080000:0.0:1788483063.852330:0:14286:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483063.852339:0:14286:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483063.852368:0:14286:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788483063.852376:0:14286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788483063.928770:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483063.928940:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483063.928945:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483063.928982:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788483063.928988:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788483063.929128:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098691200:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788483063.929209:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c61766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483063.932149:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098691200:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788483063.944234:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483063.944269:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087084288 00000100:00100000:2.0:1788483063.944277:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087084288 00000100:00100000:2.0:1788483063.944321:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:2.0:1788483063.944330:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11411:x1875360087084288:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788483063.944361:0:6494:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788483063.944459:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11411:x1875360087084288:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 129us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483063.944466:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:0.0:1788483063.960629:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483063.960665:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087084544 00000100:00100000:0.0:1788483063.960674:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087084544 00000100:00100000:0.0:1788483063.960725:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00100000:0.0:1788483063.960734:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:11411:x1875360087084544:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483063.960764:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483063.960785:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1af08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e405 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483063.960909:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1af0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483063.960923:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1af0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483063.960934:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1af0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483063.960944:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788483063.961060:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1af08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e405 expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483063.961077:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1af0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e405 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483063.961086:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:0.0:1788483063.961089:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483063.961093:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8600, rc 0) 00000100:00100000:0.0:1788483063.961197:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:11411:x1875360087084544:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 463us (578us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788483063.961204:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00100000:3.0:1788483063.974026:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483063.974135:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087084800 00000100:00100000:1.0:1788483063.974146:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087084800 00000100:00100000:1.0:1788483063.974200:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 144 00000100:00100000:1.0:1788483063.974221:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:11411:x1875360087084800:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788483063.974299:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974316:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974327:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974502:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974511:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974517:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974523:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483063.974528:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974535:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974548:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483063.974551:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483063.974555:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.974560:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1af1d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483063.974689:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:11411:x1875360087084800:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 469us (671us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788483063.974697:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 144 00000040:00080000:2.0:1788483063.975073:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483063.975077:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483063.976557:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788483063.976571:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483063.976890:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483063.976918:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087084928 00000100:00100000:1.0:1788483063.976926:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087084928 00000100:00100000:1.0:1788483063.976986:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:1.0:1788483063.976994:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:2392:x1875360087084928:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483063.977007:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483063.977027:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1af0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e405 expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483063.977043:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483063.977048:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483063.977090:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:2392:x1875360087084928:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 96us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483063.977119:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:2.0:1788483063.998442:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483063.998836:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087085184 00000100:00100000:3.0:1788483063.998856:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087085184 00000100:00100000:3.0:1788483063.998922:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:3.0:1788483063.998934:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:11411:x1875360087085184:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788483063.999195:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:11411:x1875360087085184:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 263us (762us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788483063.999205:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:0.0:1788483064.066453:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483064.066474:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098691328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483064.066549:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483064.066607:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098691328 00000100:00100000:0.0:1788483064.066614:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098691328 00000100:00100000:0.0:1788483064.066698:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788483064.066708:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098691328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483064.066742:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788483064.066802:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098691328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483064.067284:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788483064.067336:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098691328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788483064.952285:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483065.081045:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483065.081065:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098691456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483065.081223:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.081283:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098691456 00000100:00100000:3.0:1788483065.081290:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098691456 00000100:00100000:3.0:1788483065.081341:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788483065.081350:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098691456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483065.081377:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788483065.081419:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098691456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.081426:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788483065.081446:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483065.081480:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098691456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483065.081714:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098691712:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.081769:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483065.081792:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098692224:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.081842:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483065.081868:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098692736:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.081890:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483065.081925:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788483065.081930:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098691584:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.081957:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483065.081979:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098692096:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082003:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483065.082021:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098692608:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082043:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483065.082071:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098691712 00000100:00100000:1.0:1788483065.082076:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098691712 00000100:00100000:1.0:1788483065.082124:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692224 00000100:00100000:1.0:1788483065.082128:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692224 00000100:00100000:1.0:1788483065.082147:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692736 00000100:00100000:1.0:1788483065.082149:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692736 00000100:00100000:1.0:1788483065.082164:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788483065.082170:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098691712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082206:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098691712:12345-0@lo:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483065.082213:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788483065.082226:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788483065.082232:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098692224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082260:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098692224:12345-0@lo:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483065.082266:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788483065.082277:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788483065.082282:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098692736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082308:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098692736:12345-0@lo:400:kworker.0 Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483065.082323:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788483065.082340:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098691584 00000100:00100000:1.0:1788483065.082344:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098691584 00000100:00100000:1.0:1788483065.082365:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788483065.082371:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098691584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082398:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098691584:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483065.082404:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788483065.082426:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692096 00000100:00100000:1.0:1788483065.082430:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692096 00000100:00100000:1.0:1788483065.082449:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788483065.082455:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098692096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082482:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098692096:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483065.082487:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788483065.082502:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692608 00000100:00100000:1.0:1788483065.082506:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692608 00000100:00100000:1.0:1788483065.082529:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788483065.082535:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875360098692608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082563:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875360098692608:12345-0@lo:400:kworker.0 Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483065.082568:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788483065.082595:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098691584:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082606:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098692096:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082614:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098692608:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082632:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098691712:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082641:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098692224:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.082649:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098692736:0@lo:400:kworker.0 00000100:00080000:3.0:1788483065.082872:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483065.082876:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483065.082886:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098691840:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.082919:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.082947:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098692352:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.082969:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.082994:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098692864:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083017:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.083034:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788483065.083040:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098691968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083063:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.083077:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098692480:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083115:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.083132:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098692992:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.083178:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692480 00000100:00100000:3.0:1788483065.083182:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692480 00000100:00100000:3.0:1788483065.083210:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692992 00000100:00100000:3.0:1788483065.083213:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692992 00000100:00100000:3.0:1788483065.083231:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788483065.083238:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098692480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083274:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098692480:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.083280:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788483065.083293:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788483065.083299:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098692992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083325:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098692992:12345-0@lo:400:kworker.0 Request processed in 26us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.083331:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788483065.083352:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692352 00000100:00100000:3.0:1788483065.083355:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692352 00000100:00100000:3.0:1788483065.083375:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098692864 00000100:00100000:3.0:1788483065.083378:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098692864 00000100:00100000:3.0:1788483065.083399:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098691968 00000100:00100000:3.0:1788483065.083402:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098691968 00000100:00100000:3.0:1788483065.083415:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788483065.083420:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098692352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083450:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098692352:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.083455:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788483065.083467:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788483065.083473:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098692864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083499:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098692864:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.083504:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788483065.083514:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788483065.083519:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098691968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083543:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098691968:12345-0@lo:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.083549:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1788483065.083564:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483065.083567:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483065.083569:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483065.083593:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098691968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083602:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098692480:0@lo:400:kworker.0 00000100:00100000:3.0:1788483065.083611:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098692992:0@lo:400:kworker.0 00010000:00080000:3.0:1788483065.083622:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cb7100 x1875360098692352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483065.083645:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098692352:0@lo:400:kworker.0 00010000:00080000:3.0:1788483065.083656:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fad80 x1875360098692864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483065.083664:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098692864:0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.087210:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098691840 00000100:00100000:1.0:1788483065.087222:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098691840 00000100:00100000:1.0:1788483065.087269:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788483065.087279:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098691840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483065.087364:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098691840:12345-0@lo:400:kworker.0 Request processed in 87us (4448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483065.087371:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788483065.087413:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098691840:0@lo:400:kworker.0 00000100:00100000:0.0:1788483065.592599:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098693120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483065.592662:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483065.592766:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098693120 00000100:00100000:3.0:1788483065.592774:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098693120 00000100:00100000:3.0:1788483065.592840:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788483065.592850:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098693120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483065.592871:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788483065.592922:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098693120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.592929:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788483065.593193:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098693120:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1788483065.773273:0:14338:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483065.773283:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483065.773314:0:14338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788483065.773322:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483065.966177:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483065.966241:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087085440 00000100:00100000:3.0:1788483065.966250:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087085440 00000100:00100000:3.0:1788483065.966316:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 145 00000100:00100000:3.0:1788483065.966325:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:11432:x1875360087085440:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483065.966349:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483065.966366:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e40c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788483065.966510:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788483065.966581:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1af2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.966595:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1af2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.966621:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1af2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483065.966633:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788483065.966728:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e40c expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.966746:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1af2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e40c expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.966755:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:3.0:1788483065.966757:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788483065.966760:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529c00, rc 0) 00000100:00100000:3.0:1788483065.966860:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:11432:x1875360087085440:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 535us (691us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788483065.966867:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 145 00000100:00100000:0.0:1788483065.977310:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483065.977589:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087085568 00000100:00100000:3.0:1788483065.977600:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087085568 00000100:00100000:3.0:1788483065.977657:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 146 00000100:00100000:3.0:1788483065.977667:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:11432:x1875360087085568:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:3.0:1788483065.977730:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977747:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977759:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977821:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977837:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977845:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977852:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483065.977857:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977865:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977877:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:3.0:1788483065.977881:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483065.977885:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483065.977892:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528c00/0x1d7ea3d89ea1af39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483065.977959:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:11432:x1875360087085568:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 293us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483065.977966:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 146 00010000:00010000:3.0:1788483065.980008:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483066.041340:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483066.041350:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483066.041370:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788483066.041379:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483066.145513:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483066.145611:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087085696 00000100:00100000:3.0:1788483066.145621:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087085696 00000100:00100000:3.0:1788483066.145708:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:3.0:1788483066.145720:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087085696:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:3.0:1788483066.145737:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483066.145757:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1af40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e413 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483066.145782:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a15f5, atime: 0x6a9a15f4, ctime: 0x6a9a15f5, blocks: 0x8 00010000:00010000:3.0:1788483066.145813:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788483066.145818:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483066.145836:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1af40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e413 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483066.145857:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1af40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e413 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483066.145870:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528c00, rc 0) 00000100:00080000:1.0:1788483066.145994:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483066.146200:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087085696:12345-192.168.206.54@tcp:101:cat.0 Request processed in 480us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483066.146207:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:1.0:1788483066.159842:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483066.159990:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087085824 00000100:00100000:0.0:1788483066.160010:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087085824 00002000:00100000:0.0:1788483066.160057:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9a69fd936d80 x1875360087085824/t0(0) o3->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:572/0 lens 488/0 e 0 to 0 dl 1788483077 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788483066.160068:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69fd936d80 with x1875360087085824 ext(0->4095) 00002000:00010000:0.0:1788483066.160074:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69fd936d80 00000100:00100000:0.0:1788483066.160150:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:0.0:1788483066.160160:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2390:x1875360087085824:12345-192.168.206.54@tcp:3:cat.0 00000100:00100000:0.0:1788483066.160338:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2390:x1875360087085824:12345-192.168.206.54@tcp:3:cat.0 Request processed in 179us (512us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788483066.160346:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00002000:00100000:0.0:1788483066.160353:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9a69fd936d80 x1875360087085824/t0(0) o3->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:572/0 lens 488/4536 e 0 to 0 dl 1788483077 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788483066.160375:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69fd936d80 with x1875360087085824 ext(0->4095) 00002000:00010000:0.0:1788483066.160379:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69fd936d80 00000040:00080000:0.0:1788483066.360719:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788483066.616673:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483066.616697:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098693248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483066.616771:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483066.616866:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483066.616876:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098693376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483066.616905:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483066.616987:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098693376 00000100:00100000:1.0:1788483066.616995:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098693376 00000100:00100000:1.0:1788483066.617056:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788483066.617066:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098693376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483066.617113:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483066.617207:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098693376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483066.617214:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788483066.617253:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098693376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483066.617352:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098693248 00000100:00100000:3.0:1788483066.617356:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098693248 00000100:00100000:3.0:1788483066.617382:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788483066.617389:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098693248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483066.617407:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483066.617444:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098693248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483066.617459:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788483066.617489:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098693248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483066.617547:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483066.617557:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098693504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483066.617585:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483066.618000:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098693504 00000100:00100000:3.0:1788483066.618005:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098693504 00000100:00100000:3.0:1788483066.618040:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788483066.618047:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098693504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483066.618062:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483066.618117:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098693504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483066.618123:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788483066.618156:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098693504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788483067.001205:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788483067.647753:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788483067.647782:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:1.0:1788483068.025440:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483068.051531:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483068.051640:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483068.051675:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483068.051699:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483068.051740:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483068.051763:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483068.051832:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483068.052225:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086208 00000100:00100000:2.0:1788483068.052239:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086208 00000100:00100000:2.0:1788483068.052313:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086720 00000100:00100000:2.0:1788483068.052317:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086720 00000100:00100000:2.0:1788483068.052332:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086080 00000100:00100000:2.0:1788483068.052334:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086080 00000100:00100000:2.0:1788483068.052348:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086592 00000100:00100000:2.0:1788483068.052351:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086592 00000100:00100000:2.0:1788483068.052373:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 305 00000100:00100000:2.0:1788483068.052385:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087086208:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483068.052517:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087086208:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 134us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483068.052527:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 305 00000100:00100000:2.0:1788483068.052549:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 306 00000100:00100000:2.0:1788483068.052557:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087086720:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483068.052586:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087086720:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 30us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483068.056169:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 306 00000100:00100000:2.0:1788483068.056242:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 307 00000100:00100000:2.0:1788483068.056259:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:2391:x1875360087086080:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483068.056359:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:2391:x1875360087086080:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 107us (4617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483068.056366:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 307 00000100:00100000:2.0:1788483068.056379:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 308 00000100:00100000:2.0:1788483068.056386:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087086592:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483068.056413:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087086592:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483068.056419:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 308 00000100:00100000:2.0:1788483068.056453:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086464 00000100:00100000:2.0:1788483068.056462:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086464 00000100:00100000:2.0:1788483068.056518:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086336 00000100:00100000:2.0:1788483068.056522:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086336 00000100:00100000:2.0:1788483068.056554:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:2.0:1788483068.056560:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087086464:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483068.056588:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087086464:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (4912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483068.056595:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:2.0:1788483068.056606:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:2.0:1788483068.056612:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087086336:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483068.056634:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087086336:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483068.056640:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00080000:2.0:1788483068.056681:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483068.056685:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483068.056688:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483068.056692:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483068.059143:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087085952 00000100:00100000:1.0:1788483068.059163:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087085952 00000100:00100000:1.0:1788483068.059234:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 387 00000100:00100000:1.0:1788483068.059245:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087085952:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483068.059334:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087085952:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 92us (7818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483068.059342:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 387 00000001:00080000:1.0:1788483068.669755:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788483068.669806:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a69d1c30480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788483068.669811:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69d1d84300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a69d1c30780 00000020:00080000:1.0:1788483068.669824:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69d1d84000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c3d41e00 00000020:00080000:1.0:1788483068.669846:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788483068.669860:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788483068.669933:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788483068.674408:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483068.674432:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483068.674441:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483068.674447:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483068.674452:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483068.674460:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483068.674485:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a69c32fad00) 00010000:00010000:2.0:1788483068.674489:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483068.674494:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483068.674500:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1aebb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483068.675769:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788483068.675792:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1788483069.048269:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483069.176495:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098693632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483069.176565:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483069.176692:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098693632 00000100:00100000:1.0:1788483069.176700:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098693632 00000100:00100000:1.0:1788483069.176751:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788483069.176759:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098693632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483069.176808:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788483069.176875:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098693632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483069.176882:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788483069.176948:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098693632:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788483070.073246:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483070.201091:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098693760:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201201:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201257:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098694272:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201289:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201311:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098694784:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201334:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201351:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098695296:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201370:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201397:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788483070.201402:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098694144:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201428:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201444:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098694656:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201461:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201474:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098695168:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201491:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201519:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098693888:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201561:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201582:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098694400:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201605:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201630:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201672:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788483070.201677:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098694016:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201715:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201734:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098694528:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201756:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.201766:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098695040:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.201786:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483070.201790:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694272 00000100:00100000:2.0:1788483070.201800:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694272 00000100:00100000:1.0:1788483070.201824:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098693760 00000100:00100000:1.0:1788483070.201828:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098693760 00000100:00100000:1.0:1788483070.201880:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788483070.201890:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098693760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.203352:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098693760:12345-0@lo:400:kworker.0 Request processed in 1458us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.203365:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788483070.203425:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694784 00000100:00100000:1.0:1788483070.203434:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694784 00000100:00100000:1.0:1788483070.203481:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695296 00000100:00100000:1.0:1788483070.203484:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695296 00000100:00100000:1.0:1788483070.203500:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694656 00000100:00100000:1.0:1788483070.203503:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694656 00000100:00100000:1.0:1788483070.203518:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695168 00000100:00100000:1.0:1788483070.203521:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695168 00000100:00100000:1.0:1788483070.203538:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788483070.203545:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098694784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.203582:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098694784:12345-0@lo:400:kworker.0 Request processed in 37us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.203608:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788483070.203622:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788483070.203628:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098695296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.203664:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098695296:12345-0@lo:400:kworker.0 Request processed in 37us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.203670:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788483070.203681:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788483070.203687:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098694656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.203731:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098694656:12345-0@lo:400:kworker.0 Request processed in 44us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.203738:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788483070.203750:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788483070.203757:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098695168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.203787:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098695168:12345-0@lo:400:kworker.0 Request processed in 31us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.203793:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788483070.203824:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694016 00000100:00100000:1.0:1788483070.203829:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694016 00000100:00100000:1.0:1788483070.203854:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788483070.203861:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098694016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.205519:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098694016:12345-0@lo:400:kworker.0 Request processed in 1650us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.205535:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788483070.205591:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483070.205619:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098695424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483070.206596:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098694656:0@lo:400:kworker.0 00000100:00100000:0.0:1788483070.206616:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098695168:0@lo:400:kworker.0 00000100:00100000:0.0:1788483070.206628:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098693760:0@lo:400:kworker.0 00000100:00100000:0.0:1788483070.206641:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788483070.206647:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788483070.206674:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a68c3da7800, transno 4294967305 00000100:00100000:0.0:1788483070.206693:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098694784:0@lo:400:kworker.0 00000100:00100000:0.0:1788483070.206706:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788483070.206709:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a68c3ec5880, transno 4294967311 00000004:00080000:0.0:1788483070.206723:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788483070.206739:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098695296:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.207137:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.207329:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098694016:0@lo:400:kworker.0 00000100:00100000:2.0:1788483070.207620:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788483070.207632:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098694272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483070.207735:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098694272:12345-0@lo:400:kworker.0 Request processed in 105us (6445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483070.207744:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788483070.208026:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695424 00000100:00100000:3.0:1788483070.208036:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695424 00000100:00100000:1.0:1788483070.210066:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098694272:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.211319:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694144 00000100:00100000:1.0:1788483070.211337:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694144 00000100:00100000:1.0:1788483070.211398:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098693888 00000100:00100000:1.0:1788483070.211401:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098693888 00000100:00100000:1.0:1788483070.211415:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694400 00000100:00100000:1.0:1788483070.211419:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694400 00000100:00100000:1.0:1788483070.211436:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694912 00000100:00100000:1.0:1788483070.211438:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694912 00000100:00100000:1.0:1788483070.211450:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098694528 00000100:00100000:1.0:1788483070.211454:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098694528 00000100:00100000:1.0:1788483070.211469:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695040 00000100:00100000:1.0:1788483070.211472:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695040 00000100:00100000:1.0:1788483070.211492:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788483070.211503:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098694144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.211627:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098694144:12345-0@lo:400:kworker.0 Request processed in 125us (10197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.211635:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788483070.211654:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788483070.211660:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098693888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212292:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098693888:12345-0@lo:400:kworker.0 Request processed in 625us (10724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.212304:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788483070.212327:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788483070.212337:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098694400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212399:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098694400:12345-0@lo:400:kworker.0 Request processed in 65us (10793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.212405:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788483070.212418:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788483070.212424:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098694912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212450:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098694912:12345-0@lo:400:kworker.0 Request processed in 26us (10795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.212456:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788483070.212466:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788483070.212472:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098694528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212499:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098694528:12345-0@lo:400:kworker.0 Request processed in 27us (10742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.212504:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788483070.212514:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788483070.212521:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098695040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212548:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098695040:12345-0@lo:400:kworker.0 Request processed in 28us (10761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.212554:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00080000:1.0:1788483070.212627:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cb4700 x1875360098694528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483070.212645:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098694528:0@lo:400:kworker.0 00010000:00080000:1.0:1788483070.212658:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3d47800 x1875360098695040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483070.212666:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098695040:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212706:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098693888:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212719:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098694400:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212731:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788483070.212781:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098694144:0@lo:400:kworker.0 00000100:00080000:0.0:1788483070.216185:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483070.216200:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483070.216205:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483070.216210:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483070.217312:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788483070.217329:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098695424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483070.217373:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788483070.217486:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098695424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (11792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483070.217494:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788483070.217962:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098695424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483070.714371:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098695552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483070.714456:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483070.714710:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695552 00000100:00100000:1.0:1788483070.714719:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695552 00000100:00100000:1.0:1788483070.714786:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788483070.714797:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098695552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483070.714841:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788483070.714896:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098695552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483070.714903:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788483070.719058:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098695552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483071.046024:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483071.046373:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086848 00000100:00100000:1.0:1788483071.046386:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086848 00000100:00100000:1.0:1788483071.046487:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 147 00000100:00100000:1.0:1788483071.046500:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11073:x1875360087086848:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788483071.046646:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11073:x1875360087086848:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 Request processed in 149us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483071.046655:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 147 00000100:00080000:0.0:1788483071.048205:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483071.057064:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483071.057480:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087086976 00000100:00100000:2.0:1788483071.057495:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087086976 00000100:00100000:2.0:1788483071.057590:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00100000:2.0:1788483071.057604:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:11073:x1875360087086976:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788483071.057761:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:11073:x1875360087086976:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 Request processed in 159us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483071.057779:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00080000:0.0:1788483071.059157:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483071.066550:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483071.066788:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087087232 00000100:00100000:2.0:1788483071.066809:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087087232 00000100:00100000:2.0:1788483071.066881:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:2.0:1788483071.066892:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:11073:x1875360087087232:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483071.067252:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:11073:x1875360087087232:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 360us (714us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788483071.067262:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 35 00010000:00010000:3.0:1788483071.099889:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483071.419860:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483071.420154:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087087360 00000100:00100000:2.0:1788483071.420167:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087087360 00000100:00100000:2.0:1788483071.420291:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 149 00000100:00080000:0.0:1788483071.420393:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483071.420533:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:11892:x1875360087087360:12345-192.168.206.54@tcp:101:lsof.0 00010000:00010000:2.0:1788483071.420560:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483071.420588:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1af47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e41a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483071.420705:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483071.420722:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483071.420735:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483071.420811:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483071.420816:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483071.420869:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483071.421024:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1af47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483071.421049:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483071.421059:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:2.0:1788483071.421063:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483071.421068:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6a00, rc 0) 00000100:00100000:2.0:1788483071.421452:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:11892:x1875360087087360:12345-192.168.206.54@tcp:101:lsof.0 Request processed in 1148us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483071.421462:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 149 00000100:00100000:0.0:1788483071.736955:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483071.736985:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098695680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483071.737092:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483071.737541:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695680 00000100:00100000:1.0:1788483071.737553:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695680 00000100:00100000:1.0:1788483071.737617:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788483071.737628:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098695680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483071.737673:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483071.737753:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098695680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483071.737761:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788483071.737827:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098695680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483071.740029:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098695808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483071.740134:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483071.740410:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098695936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483071.740445:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483071.740512:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695808 00000100:00100000:2.0:1788483071.740523:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695808 00000100:00100000:2.0:1788483071.740579:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098695936 00000100:00100000:2.0:1788483071.740583:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098695936 00000100:00100000:2.0:1788483071.740600:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788483071.740609:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098695808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483071.740649:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483071.740670:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788483071.740681:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f658a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098695936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483071.740692:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483071.741902:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098695808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1289us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483071.741913:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788483071.744130:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f658a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098695936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3411us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483071.744146:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788483071.744749:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098695808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483071.745230:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098695936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788483072.120419:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483073.144306:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483073.165842:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483073.165899:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483073.165941:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483073.165963:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483073.165991:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483073.166011:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483073.166037:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483073.166071:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087087744 00000100:00100000:3.0:1788483073.166083:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087087744 00000100:00100000:3.0:1788483073.166198:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087088256 00000100:00100000:3.0:1788483073.166202:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087088256 00000100:00100000:3.0:1788483073.166218:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087087616 00000100:00100000:3.0:1788483073.166221:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087087616 00000100:00100000:3.0:1788483073.166236:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087088128 00000100:00100000:3.0:1788483073.166238:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087088128 00000100:00100000:3.0:1788483073.166257:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 315 00000100:00100000:3.0:1788483073.166267:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087087744:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483073.166365:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087087744:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 98us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483073.166392:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 315 00000100:00100000:3.0:1788483073.166413:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 316 00000100:00100000:3.0:1788483073.166420:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087088256:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483073.166450:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087088256:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 31us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483073.166457:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 316 00000100:00100000:3.0:1788483073.166469:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 317 00000100:00100000:3.0:1788483073.166475:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:2390:x1875360087087616:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483073.166504:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:2390:x1875360087087616:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483073.166510:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 317 00000100:00100000:3.0:1788483073.166523:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 318 00000100:00100000:3.0:1788483073.166529:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2390:x1875360087088128:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483073.166553:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2390:x1875360087088128:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483073.166560:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 318 00000100:00100000:1.0:1788483073.166915:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087087488 00000100:00100000:1.0:1788483073.166921:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087087488 00000100:00100000:1.0:1788483073.166971:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 389 00000100:00100000:1.0:1788483073.166979:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087087488:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483073.167022:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087087488:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 45us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483073.167029:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 389 00000100:00100000:1.0:1788483073.167062:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087088000 00000100:00100000:1.0:1788483073.167066:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087088000 00000100:00100000:1.0:1788483073.167119:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087087872 00000100:00100000:1.0:1788483073.167123:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087087872 00000100:00100000:1.0:1788483073.167149:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:1.0:1788483073.167156:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087088000:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483073.167185:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087088000:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 30us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483073.167202:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:1.0:1788483073.167215:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00100000:1.0:1788483073.167220:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087087872:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483073.167247:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087087872:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 27us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483073.167253:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00080000:0.0:1788483073.167575:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483073.167580:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483073.167583:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483073.167586:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788483074.172643:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483074.302140:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483074.302181:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098696064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483074.302297:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483074.302889:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696064 00000100:00100000:0.0:1788483074.302901:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696064 00000100:00100000:0.0:1788483074.302969:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788483074.302982:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098696064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483074.303039:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788483074.303148:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098696064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483074.303155:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788483074.304245:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098696064:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788483074.824642:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788483074.824673:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788483074.824779:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788483074.824802:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788483075.192592:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483075.321231:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098696448:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.321307:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.321355:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098696960:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.321381:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.321398:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098697472:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.321418:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.321442:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788483075.321447:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098696576:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.321469:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.321490:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098697088:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.321512:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.321527:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098697600:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.321548:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.321575:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696448 00000100:00100000:1.0:1788483075.321582:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696448 00000100:00100000:1.0:1788483075.321624:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788483075.321646:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098696448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.321699:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098696448:12345-0@lo:400:kworker.0 Request processed in 55us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.321706:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788483075.322255:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098696192:0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.322305:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483075.331600:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098696704:0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.331659:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483075.331693:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696704 00000100:00100000:2.0:1788483075.331701:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696704 00000100:00100000:2.0:1788483075.331772:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788483075.331792:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098696704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.331860:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098696704:12345-0@lo:400:kworker.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483075.331868:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788483075.331908:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098696704:0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.331916:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098697216:0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.331956:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483075.331979:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697088 00000100:00100000:2.0:1788483075.331984:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697088 00000100:00100000:2.0:1788483075.332020:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697600 00000100:00100000:2.0:1788483075.332023:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697600 00000100:00100000:2.0:1788483075.332036:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697216 00000100:00100000:2.0:1788483075.332038:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697216 00000100:00100000:2.0:1788483075.332052:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788483075.332057:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098697088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.332089:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098697088:12345-0@lo:400:kworker.0 Request processed in 32us (10577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483075.332115:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788483075.332126:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788483075.332132:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098697600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.332159:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098697600:12345-0@lo:400:kworker.0 Request processed in 27us (10611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483075.332164:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788483075.332173:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788483075.332178:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098697216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.332199:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098697216:12345-0@lo:400:kworker.0 Request processed in 22us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483075.332204:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788483075.332218:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483075.332221:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483075.332240:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098697216:0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.332247:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098697728:0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.332279:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.334435:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696192 00000100:00100000:1.0:1788483075.334448:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696192 00000100:00100000:1.0:1788483075.334509:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788483075.334520:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098696192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.334597:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098696192:12345-0@lo:400:kworker.0 Request processed in 79us (12290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.334604:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788483075.334646:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696960 00000100:00100000:1.0:1788483075.334651:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696960 00000100:00100000:1.0:1788483075.334684:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697472 00000100:00100000:1.0:1788483075.334688:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697472 00000100:00100000:1.0:1788483075.334701:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696576 00000100:00100000:1.0:1788483075.334703:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696576 00000100:00100000:1.0:1788483075.334716:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788483075.334733:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098696960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.334767:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098696960:12345-0@lo:400:kworker.0 Request processed in 45us (13385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.334773:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788483075.334795:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788483075.334801:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098697472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.334827:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098697472:12345-0@lo:400:kworker.0 Request processed in 27us (13408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.334832:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788483075.334856:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788483075.334862:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098696576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.334892:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098696576:12345-0@lo:400:kworker.0 Request processed in 30us (13423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.334899:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788483075.334942:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098696576:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.334955:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098697088:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.334965:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098697600:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.334977:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098696448:0@lo:400:kworker.0 00010000:00080000:1.0:1788483075.334988:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3fadc00 x1875360098696960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483075.334998:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098696960:0@lo:400:kworker.0 00010000:00080000:1.0:1788483075.335007:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d1cf1c00 x1875360098697472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483075.335015:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098697472:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335049:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697728 00000100:00100000:1.0:1788483075.335053:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697728 00000100:00100000:1.0:1788483075.335079:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788483075.335085:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098697728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335140:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098697728:12345-0@lo:400:kworker.0 Request processed in 54us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.335146:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788483075.335177:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098696320:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335225:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.335254:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098696832:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335279:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.335306:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098697344:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335326:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.335335:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098697856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483075.335355:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483075.335381:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696320 00000100:00100000:1.0:1788483075.335385:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696320 00000100:00100000:1.0:1788483075.335400:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098696832 00000100:00100000:1.0:1788483075.335403:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098696832 00000100:00100000:1.0:1788483075.335415:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697344 00000100:00100000:1.0:1788483075.335417:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697344 00000100:00100000:1.0:1788483075.335429:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788483075.335434:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098696320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335466:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098696320:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.335472:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788483075.335486:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788483075.335491:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098696832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335516:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098696832:12345-0@lo:400:kworker.0 Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.335523:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788483075.335534:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788483075.335540:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098697344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335565:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098697344:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483075.335577:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788483075.335604:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098696320:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335613:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098696832:0@lo:400:kworker.0 00000100:00100000:1.0:1788483075.335621:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098697344:0@lo:400:kworker.0 00000100:00080000:2.0:1788483075.335875:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483075.335880:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483075.335883:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788483075.335908:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098697728:0@lo:400:kworker.0 00000100:00100000:2.0:1788483075.335935:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098696192:0@lo:400:kworker.0 00000100:00100000:0.0:1788483075.336217:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697856 00000100:00100000:0.0:1788483075.336221:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697856 00000100:00100000:0.0:1788483075.336260:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788483075.336267:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098697856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483075.336298:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788483075.336352:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098697856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483075.336358:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788483075.338906:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098697856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483075.832238:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098697984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483075.832308:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483075.832443:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098697984 00000100:00100000:2.0:1788483075.832451:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098697984 00000100:00100000:2.0:1788483075.832492:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788483075.832501:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098697984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788483075.833406:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788483075.833470:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098697984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 968us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483075.833477:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788483075.833564:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098697984:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788483076.132296:0:14535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:51:13 (1788483073) 00010000:00010000:1.0:1788483076.222855:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483076.281233:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483076.281243:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483076.281343:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788483076.281351:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788483076.608342:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788483076.856872:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483076.858778:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098698240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483076.858861:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483076.858935:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098698240 00000100:00100000:2.0:1788483076.858942:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098698240 00000100:00100000:2.0:1788483076.858987:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788483076.858996:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098698240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483076.859025:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788483076.859078:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098698240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483076.859086:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788483076.859146:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098698240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483076.859283:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483076.859292:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098698368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483076.859318:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483076.859561:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098698368 00000100:00100000:3.0:1788483076.859566:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098698368 00000100:00100000:3.0:1788483076.859601:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788483076.859609:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098698368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483076.859627:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483076.859744:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098698368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483076.859751:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788483076.859829:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098698368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483076.862717:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098698112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483076.862811:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483076.862981:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098698112 00000100:00100000:2.0:1788483076.862988:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098698112 00000100:00100000:2.0:1788483076.863035:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788483076.863044:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098698112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483076.863065:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483076.863232:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098698112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483076.863239:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788483076.863319:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098698112:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483077.240283:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483077.772143:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483077.772350:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087088512 00000100:00100000:1.0:1788483077.772363:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087088512 00000100:00100000:1.0:1788483077.772469:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:1.0:1788483077.772483:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:12161:x1875360087088512:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483077.772511:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483077.772537:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1af55 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e421 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.772634:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.772652:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.772668:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.772887:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.772921:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.772934:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773044:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1af6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773053:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1af6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773060:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1af6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483077.773071:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788483077.773344:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773353:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773360:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773366:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483077.773370:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773376:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773399:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69df0bf000) 00010000:00010000:1.0:1788483077.773402:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483077.773406:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773412:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1af5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773425:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773431:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773437:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773442:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483077.773445:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773451:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773459:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a69d9bfeb00) 00010000:00010000:1.0:1788483077.773461:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483077.773465:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773471:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1af63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788483077.773523:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788483077.773845:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1af55 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e421 expref: 16 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773863:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1af6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e421 expref: 15 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483077.773871:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:1.0:1788483077.773873:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483077.773876:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27800, rc 0) 00000100:00100000:1.0:1788483077.773953:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:12161:x1875360087088512:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 1473us (1859us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788483077.773962:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:1.0:1788483077.781254:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483077.783883:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483077.783945:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087088768 00000100:00100000:0.0:1788483077.783958:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087088768 00000100:00100000:0.0:1788483077.784045:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:0.0:1788483077.784058:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:2391:x1875360087088768:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483077.784078:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483077.784135:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1af6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e421 expref: 15 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483077.784159:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:0.0:1788483077.784165:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483077.784241:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:2391:x1875360087088768:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 185us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483077.784249:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:3.0:1788483077.784862:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087088640 00000100:00100000:3.0:1788483077.784869:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087088640 00000100:00100000:3.0:1788483077.784933:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:3.0:1788483077.784943:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:12161:x1875360087088640:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788483077.785043:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:12161:x1875360087088640:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 103us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483077.785051:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:1.0:1788483077.809605:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483077.809701:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087088896 00000100:00100000:3.0:1788483077.809715:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087088896 00000100:00100000:3.0:1788483077.809827:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00100000:3.0:1788483077.809840:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:12161:x1875360087088896:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788483077.809995:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:12161:x1875360087088896:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 158us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483077.810004:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00080000:2.0:1788483077.810607:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788483078.269928:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483078.285925:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483078.285975:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483078.286050:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089152 00000100:00100000:3.0:1788483078.286059:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089152 00000100:00100000:3.0:1788483078.286133:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 325 00000100:00100000:3.0:1788483078.286144:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:2391:x1875360087089152:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483078.286154:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089024 00000100:00100000:2.0:1788483078.286160:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089024 00000100:00100000:3.0:1788483078.286225:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:2391:x1875360087089152:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483078.286233:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 325 00000100:00100000:2.0:1788483078.286254:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 391 00000100:00100000:2.0:1788483078.286273:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087089024:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483078.286301:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087089024:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483078.286308:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 391 00000100:00100000:0.0:1788483078.288474:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483078.288502:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483078.288532:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483078.288562:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483078.288580:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483078.288632:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089664 00000100:00100000:3.0:1788483078.288640:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089664 00000100:00100000:3.0:1788483078.288696:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089280 00000100:00100000:3.0:1788483078.288699:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089280 00000100:00100000:3.0:1788483078.288709:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089792 00000100:00100000:3.0:1788483078.288712:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089792 00000100:00100000:3.0:1788483078.288726:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 326 00000100:00100000:3.0:1788483078.288734:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2391:x1875360087089664:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483078.288806:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2391:x1875360087089664:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 71us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483078.288813:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 326 00000100:00100000:3.0:1788483078.288829:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 327 00000100:00100000:3.0:1788483078.288835:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087089280:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483078.288860:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087089280:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483078.288866:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 327 00000100:00100000:3.0:1788483078.288877:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 328 00000100:00100000:3.0:1788483078.288890:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087089792:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483078.288930:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2390:x1875360087089792:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 46us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483078.288936:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 328 00000100:00080000:0.0:1788483078.289335:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483078.289339:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483078.289621:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089408 00000100:00100000:1.0:1788483078.289627:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089408 00000100:00100000:1.0:1788483078.289705:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089536 00000100:00100000:1.0:1788483078.289708:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089536 00000100:00100000:2.0:1788483078.289754:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00100000:2.0:1788483078.289782:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087089408:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483078.289818:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087089408:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 38us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483078.289824:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00080000:0.0:1788483078.290373:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483078.290377:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483078.290614:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 144 00000100:00100000:1.0:1788483078.290623:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087089536:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483078.290662:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087089536:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 41us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483078.290669:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 144 00000040:00080000:0.0:1788483078.328913:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483078.328924:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483078.329498:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788483078.329509:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788483078.649632:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788483079.294211:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483079.416520:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483079.416545:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098698496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483079.416621:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483079.416693:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098698496 00000100:00100000:1.0:1788483079.416700:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098698496 00000100:00100000:1.0:1788483079.416745:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788483079.416755:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098698496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483079.416799:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788483079.416857:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098698496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483079.416864:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788483079.416922:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098698496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483079.789542:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483079.789714:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087089920 00000100:00100000:3.0:1788483079.789727:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087089920 00000100:00100000:3.0:1788483079.789838:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:3.0:1788483079.789852:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:12204:x1875360087089920:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483079.789879:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483079.789916:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1af78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e428 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790006:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788483079.790087:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788483079.790282:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790299:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790318:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790325:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790332:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790394:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790418:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790425:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790432:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483079.790437:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790446:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790460:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:3.0:1788483079.790463:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483079.790469:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790477:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1af7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790495:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790501:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790508:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790513:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483079.790522:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790529:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790537:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483079.790540:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483079.790542:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790548:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1af86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790591:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1af78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e428 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790603:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:3.0:1788483079.790605:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483079.790610:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1af78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e428 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.790621:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528000, rc 0) 00000100:00100000:3.0:1788483079.790748:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:12204:x1875360087089920:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 898us (1220us total) trans 0 rc 301/301 00000100:00100000:3.0:1788483079.790765:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:1.0:1788483079.806083:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483079.806435:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087090176 00000100:00100000:3.0:1788483079.806449:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087090176 00000100:00100000:3.0:1788483079.806523:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 154 00000100:00100000:3.0:1788483079.806536:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+14:12204:x1875360087090176:12345-192.168.206.54@tcp:36:lfs.0 00010000:00010000:3.0:1788483079.806637:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483079.806676:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1a8cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e24c expref: 14 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.806701:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:3.0:1788483079.806707:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483079.807182:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.807202:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 5 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.807213:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.807254:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 5 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.807270:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 5 pid: 8434 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483079.807287:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098698624:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483079.807400:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483079.810932:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483079.811157:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087090304 00000100:00100000:1.0:1788483079.811169:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087090304 00010000:00010000:1.0:1788483079.811221:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 6 pid: 8434 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483079.811260:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 80 00000100:00100000:1.0:1788483079.811269:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2392:x1875360087090304:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483079.811285:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483079.811292:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 6 pid: 8434 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.811308:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 6 pid: 8434 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.811350:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:1.0:1788483079.811356:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.811366:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.811374:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.811396:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483079.811450:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2392:x1875360087090304:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 182us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483079.811458:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 80 00010000:00010000:3.0:1788483079.811699:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1af4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e41a expref: 5 pid: 8434 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483079.811720:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098698624:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483079.811765:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.811783:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.811789:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.811814:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.811824:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.811833:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.812846:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.812868:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.812879:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483079.812899:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068958544 reply state 0000000028511e45 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.812913:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.812920:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483079.812930:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483079.812935:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788483079.812943:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788483079.812955:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814475:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814491:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814498:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483079.814503:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814513:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814531:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3183a00) 00010000:00010000:3.0:1788483079.814534:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483079.814538:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814544:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1af8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483079.814571:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068958544 reply state 0000000028511e45 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814584:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483079.814626:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a68c1c53800) 00010000:00010000:3.0:1788483079.814628:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483079.814632:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788483079.815403:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:12204:x1875360087090176:12345-192.168.206.54@tcp:36:lfs.0 Request processed in 8860us (9323us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788483079.815415:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 154 00000100:00100000:0.0:1788483079.924994:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483079.925224:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087090432 00000100:00100000:1.0:1788483079.925238:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087090432 00000100:00100000:1.0:1788483079.925315:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 155 00000100:00100000:1.0:1788483079.925329:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+15:12212:x1875360087090432:12345-192.168.206.54@tcp:101:lctl.0 00010000:00010000:1.0:1788483079.925363:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483079.925394:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1afa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e42f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.925480:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1afa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.925496:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1afa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.925510:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1afa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483079.925598:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483079.925603:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483079.925633:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1afa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.925662:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1afa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e42f expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.925685:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1afa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e42f expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.925695:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:1.0:1788483079.925699:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483079.925704:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26800, rc 0) 00000100:00100000:1.0:1788483079.925844:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:12212:x1875360087090432:12345-192.168.206.54@tcp:101:lctl.0 Request processed in 516us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483079.925852:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 155 00000100:00100000:1.0:1788483079.979796:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483079.981583:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087090560 00000100:00100000:2.0:1788483079.981606:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087090560 00000100:00100000:2.0:1788483079.982363:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 156 00000100:00100000:2.0:1788483079.982380:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+16:12218:x1875360087090560:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483079.982408:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483079.982440:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1afb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e436 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.982532:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.982549:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.982562:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.982574:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.982582:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.982587:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983294:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1afc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983311:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1afc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983321:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1afc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483079.983370:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788483079.983375:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483079.983401:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1afc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983416:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983423:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983431:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983438:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483079.983443:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983451:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983466:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:2.0:1788483079.983479:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483079.983484:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983492:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1afb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983510:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983517:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983523:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983529:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483079.983532:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983538:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983546:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a68c1c53800) 00010000:00010000:2.0:1788483079.983549:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483079.983552:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983558:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1afbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983594:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1afb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e436 expref: 18 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983623:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1afc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e436 expref: 17 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483079.983630:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483079.983633:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788483079.983635:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c7200, rc 0) 00000100:00100000:1.0:1788483079.989878:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:12218:x1875360087090560:12345-192.168.206.54@tcp:101:bash.0 Request processed in 7484us (10077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483079.989894:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 156 00000100:00100000:3.0:1788483079.997550:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483079.998284:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087090816 00000100:00100000:1.0:1788483079.998298:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087090816 00000100:00100000:1.0:1788483079.998413:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 157 00000100:00100000:1.0:1788483079.998426:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:12218:x1875360087090816:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:1.0:1788483079.998453:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483079.998499:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1afcc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e43d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.999250:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.999270:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483079.999283:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.005271:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.005304:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.005320:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483080.009291:0:6493:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788483080.010038:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010250:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010268:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010327:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010364:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010373:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010381:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483080.010387:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010397:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010413:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483080.010416:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483080.010422:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010428:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1afd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483080.010445:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086f68f6d reply state 0000000092ec844e transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010457:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.010462:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69df303000) 00010000:00010000:1.0:1788483080.010465:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788483080.010468:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788483080.010969:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27c00/0x1d7ea3d89ea1afcc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.011001:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.011011:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483080.011014:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483080.011017:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27600, rc 0) 00000100:00100000:1.0:1788483080.011196:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:12218:x1875360087090816:12345-192.168.206.54@tcp:101:bash.0 Request processed in 12770us (13659us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788483080.011208:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 157 00000100:00100000:2.0:1788483080.024793:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483080.025317:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087090944 00000100:00100000:0.0:1788483080.025335:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087090944 00000100:00100000:0.0:1788483080.025483:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:0.0:1788483080.025498:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2392:x1875360087090944:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483080.025523:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483080.025551:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e444 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483080.025584:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483080.025611:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788483080.025617:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483080.025629:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.025655:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.025673:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8a00, rc 0) 00000100:00100000:0.0:1788483080.025773:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087090944:12345-192.168.206.54@tcp:101:bash.0 Request processed in 279us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483080.025781:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00080000:2.0:1788483080.026050:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483080.031156:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.031733:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087091072 00000100:00100000:1.0:1788483080.031747:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087091072 00000100:00100000:1.0:1788483080.031847:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:1.0:1788483080.031861:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:12218:x1875360087091072:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:1.0:1788483080.031885:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483080.031911:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e44b expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.031956:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.031978:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483080.031984:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483080.031989:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.032067:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.032153:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 7 pid: 8412 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483080.032172:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875360098698752:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483080.032296:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483080.036451:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875360098698752:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483080.036502:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.036530:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27c00, rc 0) 00000100:00100000:1.0:1788483080.036671:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:12218:x1875360087091072:12345-192.168.206.54@tcp:101:bash.0 Request processed in 4812us (5587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.036683:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:2.0:1788483080.037003:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483080.037162:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087091200 00000100:00100000:0.0:1788483080.037174:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087091200 00010000:00010000:0.0:1788483080.037217:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 7 pid: 8412 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483080.037408:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 81 00000100:00100000:0.0:1788483080.037420:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087091200:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483080.037439:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483080.037468:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 7 pid: 8412 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.037485:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 7 pid: 8412 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.037512:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1afef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e444 expref: 7 pid: 8412 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.037527:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483080.037532:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483080.037542:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.037565:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.037609:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483080.037625:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6480:1875360098698880:192.168.206.54@tcp:105: 00000100:00100000:0.0:1788483080.037730:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483080.043006:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6480:1875360098698880:192.168.206.54@tcp:105: 00010000:00010000:1.0:1788483080.043046:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483080.043139:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087091200:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 5719us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.044183:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 81 00000100:00100000:1.0:1788483080.044660:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483080.044780:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087091456 00000100:00100000:2.0:1788483080.044791:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087091456 00000100:00100000:2.0:1788483080.044855:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:2.0:1788483080.044868:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:12218:x1875360087091456:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:2.0:1788483080.045447:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12218:x1875360087091456:12345-192.168.206.54@tcp:35:bash.0 Request processed in 511us (717us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788483080.045457:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:2.0:1788483080.177545:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.179278:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087091712 00000100:00100000:3.0:1788483080.179300:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087091712 00000100:00100000:3.0:1788483080.179411:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 158 00000100:00100000:3.0:1788483080.179423:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12228:x1875360087091712:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483080.179461:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483080.179495:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1affd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e452 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483080.179667:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788483080.180035:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1affd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e452 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.180055:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:3.0:1788483080.180165:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483080.180172:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1affd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e452 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.180192:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76000, rc 0) 00000100:00100000:3.0:1788483080.180296:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:12228:x1875360087091712:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 873us (2769us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788483080.180333:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 158 00000100:00100000:1.0:1788483080.183999:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.184151:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087091968 00000100:00100000:3.0:1788483080.184167:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087091968 00000100:00100000:3.0:1788483080.184250:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:3.0:1788483080.184263:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:12228:x1875360087091968:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483080.184591:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:12228:x1875360087091968:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 330us (608us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788483080.184601:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:1.0:1788483080.305295:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.305570:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087092096 00000100:00100000:3.0:1788483080.305587:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087092096 00000100:00100000:3.0:1788483080.305751:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 159 00000100:00100000:3.0:1788483080.305779:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:12234:x1875360087092096:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483080.305812:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483080.305841:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b00b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e459 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.305934:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.305953:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.305967:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483080.306023:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788483080.306027:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483080.306071:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.306504:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b00b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e459 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.306533:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e459 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.306543:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483080.306547:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483080.306551:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76e00, rc 0) 00000100:00100000:2.0:1788483080.307426:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:12234:x1875360087092096:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1644us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483080.307443:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 159 00000100:00100000:1.0:1788483080.310898:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483080.310963:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087092352 00000100:00100000:2.0:1788483080.310975:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087092352 00000100:00100000:2.0:1788483080.311035:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 160 00000100:00100000:2.0:1788483080.311045:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:12234:x1875360087092352:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483080.311087:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483080.311152:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b019 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e460 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.311300:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b020 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.311318:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.311343:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483080.311360:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788483080.311503:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b019 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e460 expref: 27 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.311528:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e460 expref: 26 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.311540:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69df303700) 00010000:00010000:2.0:1788483080.311543:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483080.311547:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:2.0:1788483080.311623:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+26:12234:x1875360087092352:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 579us (739us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788483080.311629:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 160 00010000:00010000:3.0:1788483080.313476:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483080.315260:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.315361:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087092608 00000100:00100000:1.0:1788483080.315376:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087092608 00000100:00100000:1.0:1788483080.315608:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 161 00000100:00100000:1.0:1788483080.315620:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+26:12234:x1875360087092608:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:1.0:1788483080.315649:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483080.315673:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b02e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e467 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.315856:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b035 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.315872:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b035 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.315885:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b035 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483080.315899:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788483080.316025:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b02e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e467 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.316044:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b035 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e467 expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.316054:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69df303700) 00010000:00010000:1.0:1788483080.316057:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788483080.316060:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26600, rc 0) 00000100:00100000:0.0:1788483080.316566:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.316891:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:12234:x1875360087092608:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1270us (1646us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788483080.316921:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 161 00000100:00100000:3.0:1788483080.316954:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087092736 00000100:00100000:3.0:1788483080.316964:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087092736 00000100:00100000:3.0:1788483080.317028:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788483080.317037:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:2390:x1875360087092736:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483080.317050:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483080.317069:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e460 expref: 28 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.317087:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69df303700) 00010000:00010000:3.0:1788483080.317091:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483080.317151:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:2390:x1875360087092736:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 116us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483080.317158:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:0.0:1788483080.322630:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.323913:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087092864 00000100:00100000:1.0:1788483080.323933:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087092864 00000100:00100000:1.0:1788483080.324015:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:1.0:1788483080.324028:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087092864:12345-192.168.206.54@tcp:1:lfs.0 00010000:00010000:1.0:1788483080.324087:0:8551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.324139:0:8551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.324149:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483080.324154:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483080.324160:0:8551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.324209:0:8551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.324226:0:8551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 6 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483080.324244:0:8551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8551:1875360098699008:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483080.324366:0:8551:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483080.327540:0:8551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8551:1875360098699008:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483080.327591:0:8551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483080.331338:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.331943:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087092992 00000100:00100000:1.0:1788483080.331968:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087092992 00002000:00100000:1.0:1788483080.332040:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a69d1cb7100 x1875360087092992/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:586/0 lens 504/0 e 0 to 0 dl 1788483091 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483080.332053:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69d1cb7100 with x1875360087092992 ext(0->12) 00010000:00010000:1.0:1788483080.332063:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 7 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.332081:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 7 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483080.332090:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69d1cb7100 00000100:00100000:1.0:1788483080.332178:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:1.0:1788483080.332189:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087092992:12345-192.168.206.54@tcp:4:lfs.0 00000100:00100000:1.0:1788483080.341162:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087092992:12345-192.168.206.54@tcp:4:lfs.0 Request processed in 8962us (9826us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788483080.341177:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00002000:00100000:1.0:1788483080.341192:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a69d1cb7100 x1875360087092992/t4294967306(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:586/0 lens 504/448 e 0 to 0 dl 1788483091 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483080.341202:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69d1cb7100 with x1875360087092992 ext(0->12) 00010000:00010000:1.0:1788483080.341214:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 9 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.341901:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 9 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483080.341913:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69d1cb7100 00000100:00100000:0.0:1788483080.345269:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.345503:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087093120 00000100:00100000:1.0:1788483080.345516:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087093120 00010000:00010000:1.0:1788483080.345573:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 9 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483080.345799:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 82 00000100:00100000:0.0:1788483080.345813:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087093120:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483080.345836:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788483080.346252:0:6480:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788483080.346256:0:6480:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788483079 00002000:00010000:0.0:1788483080.346259:0:6480:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788483079 00002000:00010000:0.0:1788483080.346261:0:6480:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788483079 00002000:00010000:0.0:1788483080.346263:0:6480:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788483080.346272:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 9 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.346291:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 9 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.346321:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1aff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e44b expref: 9 pid: 8409 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.346343:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483080.346348:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483080.346355:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.346387:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.346527:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483080.346614:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087093120:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 802us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483080.346624:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 82 00010000:00010000:1.0:1788483080.348343:0:8551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348368:0:8551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348407:0:8551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348417:0:8551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348426:0:8551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348434:0:8551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483080.348461:0:8551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348471:0:8551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348493:0:8551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.348503:0:8551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b043 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483080.349434:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087092864:12345-192.168.206.54@tcp:1:lfs.0 Request processed in 25393us (26802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483080.349450:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:0.0:1788483080.352437:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.352613:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087093376 00000100:00100000:3.0:1788483080.352627:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087093376 00000100:00100000:3.0:1788483080.352781:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:3.0:1788483080.352793:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4623450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12234:x1875360087093376:12345-192.168.206.54@tcp:35:lfs.0 00000004:00010000:3.0:1788483080.352944:0:6496:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b035 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e467 expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483080.353361:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788483080.354600:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788483080.355587:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788483080.355724:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.355750:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.355770:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.355835:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.355920:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 31 pid: 6493 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483080.356186:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875360098699136:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483080.356306:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483080.360030:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875360098699136:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483080.360074:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483080.360394:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.364137:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087093504 00000100:00100000:3.0:1788483080.364161:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087093504 00010000:00010000:3.0:1788483080.364241:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 32 pid: 6493 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483080.364356:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 83 00000100:00100000:3.0:1788483080.364369:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:2393:x1875360087093504:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483080.364392:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483080.364402:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 32 pid: 6493 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.364419:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 32 pid: 6493 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.364447:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1afe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e43d expref: 32 pid: 6493 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.364468:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69df303700) 00010000:00010000:3.0:1788483080.364474:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.364486:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.364494:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.364540:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483080.364643:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+31:2393:x1875360087093504:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 276us (4250us total) trans 0 rc 0/0 00010000:00010000:2.0:1788483080.366012:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.366057:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483080.366296:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788483080.366730:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 83 00000001:00080000:2.0:1788483080.367274:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788483080.367722:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098699264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788483080.367837:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483080.368013:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788483080.368065:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098699264 00000100:00100000:0.0:1788483080.368075:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098699264 00000100:00100000:0.0:1788483080.368502:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788483080.368514:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098699264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788483080.368700:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098699264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 187us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483080.368708:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:2.0:1788483080.368959:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483080.369016:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098699264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788483080.369466:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788483080.369553:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098699392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788483080.369606:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483080.369750:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788483080.369837:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098699392 00000100:00100000:1.0:1788483080.369845:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098699392 00000100:00100000:1.0:1788483080.370001:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788483080.370013:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098699392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788483080.370399:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6496:x1875360098699392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 387us (792us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788483080.370407:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788483080.370499:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3cc6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098699392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788483080.370558:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788483080.370601:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.370612:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.370621:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.370627:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483080.370633:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.370641:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.370671:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69df303700) 00010000:00010000:3.0:1788483080.370675:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788483080.370681:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.370707:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b04a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788483080.370835:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788483080.371047:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788483080.371063:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372633964963ns, next at 373633961958ns, rc = 0 00000001:00080000:3.0:1788483080.371071:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788483080.371161:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69df303700) 00010000:00010000:3.0:1788483080.371165:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788483080.371174:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b035 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e467 expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483080.371310:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4623450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12234:x1875360087093376:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 18519us (18889us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788483080.371320:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 38 00000020:00080000:3.0:1788483080.371324:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788483080.381819:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.382618:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087093632 00000100:00100000:3.0:1788483080.382633:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087093632 00000100:00100000:3.0:1788483080.382719:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 162 00000100:00100000:3.0:1788483080.382732:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12234:x1875360087093632:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483080.382778:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483080.382811:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e46e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.382889:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e46e expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.382932:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e46e expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.382957:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483080.382961:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483080.382966:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529800, rc 0) 00000100:00100000:3.0:1788483080.383044:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12234:x1875360087093632:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 314us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483080.383052:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 162 00000100:00100000:0.0:1788483080.386846:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483080.387733:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087093888 00000100:00100000:2.0:1788483080.387764:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087093888 00000100:00100000:2.0:1788483080.387861:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:2.0:1788483080.387874:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12234:x1875360087093888:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483080.388480:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12234:x1875360087093888:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 605us (1652us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788483080.388491:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:0.0:1788483080.441000:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483080.441032:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098699520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483080.441156:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483080.441236:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098699904:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441294:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483080.441299:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098699776:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441319:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098700416:0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.441350:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483080.441386:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098700288:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441387:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098699776 00000100:00100000:0.0:1788483080.441398:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098699776 00000100:00100000:1.0:1788483080.441417:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483080.441440:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098700800:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441456:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700288 00000100:00100000:0.0:1788483080.441462:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700288 00000100:00100000:1.0:1788483080.441467:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483080.441492:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700800 00000100:00100000:1.0:1788483080.441494:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788483080.441496:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700800 00000100:00100000:1.0:1788483080.441513:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098699648:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441519:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788483080.441532:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098699776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.441555:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483080.441584:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098700160:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441615:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098699776:12345-0@lo:400:kworker.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.441624:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483080.441627:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788483080.441650:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788483080.441654:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098700672:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441660:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098700288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.441696:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483080.441701:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098700288:12345-0@lo:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483080.441708:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788483080.441721:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700672 00000100:00100000:0.0:1788483080.441724:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700672 00000100:00100000:1.0:1788483080.441741:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098699776:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441742:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788483080.441762:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098700800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.441773:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098700288:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.441800:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098700800:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483080.441807:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00080000:1.0:1788483080.441817:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c541bb80 x1875360098700800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483080.441823:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788483080.441834:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098700672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.441837:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098700800:0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.441871:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098699520 00000100:00100000:1.0:1788483080.441877:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098699520 00000100:00100000:0.0:1788483080.441885:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098700672:12345-0@lo:400:kworker.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483080.441893:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788483080.441924:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788483080.441927:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098700672:0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.441937:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098699520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483080.442032:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:2.0:1788483080.442034:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483080.442043:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483080.442046:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483080.442074:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098699520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.442082:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788483080.442089:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483080.442137:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098699648 00000100:00100000:1.0:1788483080.442141:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098699648 00000100:00100000:1.0:1788483080.442174:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788483080.442183:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098699648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483080.442185:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098699904 00000100:00100000:3.0:1788483080.442192:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098699904 00000100:00100000:1.0:1788483080.442229:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3622:x1875360098699648:12345-0@lo:400:kworker.0 Request processed in 48us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.442244:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788483080.442282:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700160 00000100:00100000:1.0:1788483080.442287:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700160 00000100:00100000:3.0:1788483080.442391:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788483080.442399:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788483080.442405:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098699904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.442413:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ecc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098700160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483080.442462:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098699904:12345-0@lo:400:kworker.0 Request processed in 62us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.442470:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ecc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098700160:12345-0@lo:400:kworker.0 Request processed in 59us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483080.442474:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788483080.442484:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788483080.442520:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098699648:0@lo:400:kworker.0 00000100:00100000:3.0:1788483080.442526:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098700032:0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.442535:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098700160:0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.442811:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700416 00000100:00100000:1.0:1788483080.442816:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700416 00000100:00100000:1.0:1788483080.442861:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788483080.442869:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098700416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483080.442983:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483080.443052:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098700416:12345-0@lo:400:kworker.0 Request processed in 184us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483080.443058:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098700544:0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.443064:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788483080.443079:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700032 00000100:00100000:1.0:1788483080.443083:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700032 00000100:00100000:3.0:1788483080.443150:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483080.443180:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483080.443188:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098700928:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.444208:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788483080.444241:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098700032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.444275:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700544 00000100:00100000:1.0:1788483080.444282:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700544 00000100:00100000:1.0:1788483080.444328:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788483080.444337:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098700544:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788483080.444356:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37b1c00 x1875360098700416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483080.444374:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098700416:0@lo:400:kworker.0 00000100:00100000:1.0:1788483080.444399:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098700544:12345-0@lo:400:kworker.0 Request processed in 62us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483080.444406:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098699520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483080.444410:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788483080.444448:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098699904:0@lo:400:kworker.0 00000100:00080000:1.0:1788483080.444455:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483080.444461:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483080.444689:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483080.444732:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098700544:0@lo:400:kworker.0 00000100:00100000:2.0:1788483080.444838:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098700928 00000100:00100000:2.0:1788483080.444843:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098700928 00000100:00100000:2.0:1788483080.444894:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788483080.444894:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483080.444905:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098700928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483080.444954:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098700928:12345-0@lo:400:kworker.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483080.444961:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788483080.445039:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098700928:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.445069:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098700032:12345-0@lo:400:kworker.0 Request processed in 849us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.445072:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098700032:0@lo:400:kworker.0 00000100:00100000:0.0:1788483080.445083:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788483080.513556:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483080.513670:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087094144 00000100:00100000:2.0:1788483080.513684:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087094144 00000100:00100000:2.0:1788483080.513790:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 163 00000100:00100000:2.0:1788483080.513803:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12244:x1875360087094144:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483080.513836:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483080.514460:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e475 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483080.514596:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788483080.514736:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b058 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e475 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.514769:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:2.0:1788483080.514773:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483080.515354:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e475 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.515378:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:2.0:1788483080.516306:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12244:x1875360087094144:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 2497us (2757us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788483080.516347:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 163 00000100:00100000:0.0:1788483080.522931:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.523048:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087094272 00000100:00100000:1.0:1788483080.523061:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087094272 00000100:00100000:1.0:1788483080.523382:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 164 00000100:00100000:1.0:1788483080.523396:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12244:x1875360087094272:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:1.0:1788483080.523527:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523560:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523575:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523589:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523597:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523605:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523702:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523712:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523736:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483080.523804:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523819:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523826:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523833:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523839:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483080.523845:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523853:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523868:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483080.523871:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483080.523877:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523884:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b066 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523899:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523911:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523918:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523924:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483080.523927:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523933:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523942:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69df303000) 00010000:00010000:1.0:1788483080.523945:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483080.523948:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523954:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b06d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523965:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523971:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523977:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523983:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483080.523992:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.523999:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.524008:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483080.524011:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483080.524014:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.524021:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483080.524796:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12244:x1875360087094272:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 1398us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.524807:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 164 00000100:00100000:0.0:1788483080.543558:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.543767:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087094528 00000100:00100000:3.0:1788483080.543781:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087094528 00000100:00100000:3.0:1788483080.543855:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:3.0:1788483080.543868:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12244:x1875360087094528:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483080.544208:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:12244:x1875360087094528:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 341us (663us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788483080.544218:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:2.0:1788483080.582032:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.582171:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087094784 00000100:00100000:3.0:1788483080.582191:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087094784 00000100:00100000:3.0:1788483080.582270:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 165 00000100:00100000:3.0:1788483080.582281:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:12247:x1875360087094784:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483080.582317:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483080.582356:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b07b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e47c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582455:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582474:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582486:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582497:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582505:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582534:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582681:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582689:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582697:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483080.582706:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788483080.582819:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582828:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582835:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582842:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483080.582846:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582855:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582869:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483080.582872:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483080.582882:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582889:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b082 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582905:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582912:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582918:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582923:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483080.582927:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582932:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582940:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69df303000) 00010000:00010000:3.0:1788483080.582942:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483080.582945:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582951:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.582998:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b07b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 41 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.583029:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 40 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483080.583038:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483080.583040:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483080.583043:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76000, rc 0) 00000100:00100000:3.0:1788483080.583563:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12247:x1875360087094784:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1279us (1545us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788483080.583572:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 165 00000100:00100000:0.0:1788483080.585916:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.586705:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087094912 00000100:00100000:1.0:1788483080.586720:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087094912 00000100:00100000:1.0:1788483080.586817:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 166 00000100:00100000:1.0:1788483080.586831:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12247:x1875360087094912:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:1.0:1788483080.586922:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.586945:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.586960:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.587004:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.587024:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.587032:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.587040:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483080.587045:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.587055:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.587070:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483080.587074:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788483080.587080:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.587087:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b09e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483080.587211:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12247:x1875360087094912:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 382us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.587220:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 166 00000100:00100000:0.0:1788483080.591352:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483080.591477:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087095168 00000100:00100000:3.0:1788483080.591491:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087095168 00000100:00100000:3.0:1788483080.591564:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:3.0:1788483080.591577:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12247:x1875360087095168:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483080.592421:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12247:x1875360087095168:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 841us (1077us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788483080.592435:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:2.0:1788483080.879745:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483080.879868:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087095424 00000100:00100000:0.0:1788483080.879883:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087095424 00000100:00100000:0.0:1788483080.880019:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 167 00000100:00100000:0.0:1788483080.880031:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12278:x1875360087095424:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:0.0:1788483080.880055:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483080.880076:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b0a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e483 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.880406:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b0ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.880421:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.880447:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483080.880459:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788483080.880562:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e483 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.880580:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b0ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e483 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483080.880590:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:0.0:1788483080.880594:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483080.880598:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:0.0:1788483080.880670:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:12278:x1875360087095424:12345-192.168.206.54@tcp:101:cat.0 Request processed in 641us (946us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788483080.880678:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 167 00000100:00100000:0.0:1788483080.895038:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483080.895116:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.895236:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087095552 00000100:00100000:1.0:1788483080.895256:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087095552 00000100:00100000:1.0:1788483080.895331:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:1.0:1788483080.895341:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:2390:x1875360087095552:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483080.895356:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483080.895393:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b0ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e483 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.895411:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483080.895416:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483080.895477:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:2390:x1875360087095552:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 137us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.895485:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:2.0:1788483080.895838:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087095808 00000100:00100000:2.0:1788483080.895844:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087095808 00000100:00100000:2.0:1788483080.895880:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:2.0:1788483080.895887:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:12278:x1875360087095808:12345-192.168.206.54@tcp:35:cat.0 00000100:00100000:2.0:1788483080.896428:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:12278:x1875360087095808:12345-192.168.206.54@tcp:35:cat.0 Request processed in 539us (1397us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788483080.896437:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:3.0:1788483080.953487:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483080.953512:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098701056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483080.953578:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483080.953641:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098701056 00000100:00100000:3.0:1788483080.953649:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098701056 00000100:00100000:3.0:1788483080.953690:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788483080.953699:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098701056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483080.953732:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788483080.953785:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098701056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483080.953808:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788483080.953852:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098701056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483080.983288:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483080.983441:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087096064 00000100:00100000:2.0:1788483080.983451:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087096064 00000100:00100000:2.0:1788483080.983513:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 168 00000100:00100000:2.0:1788483080.983523:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:12284:x1875360087096064:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:2.0:1788483080.983545:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483080.983548:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788483080.983572:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e459 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.983590:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483080.983594:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483080.983608:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b0ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e48a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.983735:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.983767:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 43 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.983775:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.983809:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 43 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483080.983823:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 43 pid: 6494 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483080.983836:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098701184:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483080.983940:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788483080.995568:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098701184:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483080.995596:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483080.997786:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483080.997888:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087096192 00000100:00100000:1.0:1788483080.997899:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087096192 00010000:00010000:1.0:1788483080.997937:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 44 pid: 6494 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483080.997977:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 84 00000100:00100000:1.0:1788483080.997987:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:2392:x1875360087096192:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483080.998001:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483080.998007:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 44 pid: 6494 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.998020:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 44 pid: 6494 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.998041:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b090 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e47c expref: 44 pid: 6494 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.998057:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483080.998062:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.998085:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.998092:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483080.998458:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483080.998517:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:2392:x1875360087096192:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 528us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483080.998525:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 84 00010000:00010000:2.0:1788483081.002427:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.002443:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483081.002464:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788483081.002604:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b0ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 44 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.002643:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.002652:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483081.002655:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483081.002658:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:0.0:1788483081.006681:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483081.006781:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087096320 00000100:00100000:3.0:1788483081.006790:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087096320 00000100:00100000:3.0:1788483081.006859:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 169 00000100:00100000:3.0:1788483081.006869:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:12284:x1875360087096320:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:3.0:1788483081.006900:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483081.006921:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b0cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e491 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.006953:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.006965:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.006975:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.007087:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b0cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.007143:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 45 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.007152:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483081.007155:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483081.007165:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1529400, rc 0) 00000100:00100000:3.0:1788483081.007217:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+45:12284:x1875360087096320:12345-192.168.206.54@tcp:101:dd.0 Request processed in 349us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483081.007223:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 169 00000100:00080000:1.0:1788483081.007618:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483081.008661:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:12284:x1875360087096064:12345-192.168.206.54@tcp:101:dd.0 Request processed in 25133us (25375us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788483081.008671:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 168 00000100:00100000:1.0:1788483081.014172:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483081.014261:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087096576 00000100:00100000:2.0:1788483081.014271:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087096576 00000100:00100000:2.0:1788483081.014324:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 170 00000100:00100000:2.0:1788483081.014334:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:12284:x1875360087096576:12345-192.168.206.54@tcp:36:dd.0 00010000:00010000:2.0:1788483081.014541:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.014557:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.014567:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483081.014606:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788483081.014628:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bee85ef reply state 000000009bfed61c transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.014640:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.014660:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483081.014663:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483081.014667:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483081.014762:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+47:12284:x1875360087096576:12345-192.168.206.54@tcp:36:dd.0 Request processed in 429us (597us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788483081.014769:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 170 00000020:00080000:2.0:1788483081.014774:0:8434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788483081.336399:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788483081.476458:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000004:00080000:2.0:1788483081.476493:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788483081.476517:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a68c3dc7f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788483081.476522:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69d1fbe900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c3dc73c0 00000020:00080000:2.0:1788483081.476526:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69d1fbee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c3009000 00000100:00100000:0.0:1788483081.477297:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483081.477316:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098701312:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788483081.477381:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483081.477456:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098701312 00000100:00100000:0.0:1788483081.477463:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098701312 00000100:00100000:0.0:1788483081.477505:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788483081.477521:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098701312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788483081.477548:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1788483081.477578:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a1607, atime: 0x6a9a1607, ctime: 0x6a9a1607, blocks: 0x8 00010000:00010000:0.0:1788483081.477587:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477606:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1788483081.477610:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483081.477616:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477633:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477644:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477653:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477670:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788483081.477826:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3622:x1875360098701312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 305us (444us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788483081.477833:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1788483081.477854:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483081.477860:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477891:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483081.477896:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477906:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477921:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477929:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b0e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.477947:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483081.477949:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483081.477951:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788483081.477979:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a68c447ca80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788483081.477985:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098701312:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788483081.478376:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788483081.478418:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788483081.479051:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.479064:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.479071:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.479078:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483081.479082:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.479089:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480390:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a68c1c53800) 00010000:00010000:3.0:1788483081.480396:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483081.480401:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480408:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1af94 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480432:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480458:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480464:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480469:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483081.480473:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480479:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480488:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483081.480490:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483081.480493:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480498:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1af9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480515:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480521:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480527:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480532:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483081.480540:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480547:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480556:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69df303000) 00010000:00010000:3.0:1788483081.480558:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483081.480561:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480568:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1afda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480585:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480592:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480598:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480603:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483081.480606:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480612:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480619:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483081.480622:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483081.480630:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.480636:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b0dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483081.524793:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483081.525048:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087096704 00000100:00100000:0.0:1788483081.525057:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087096704 00000100:00100000:0.0:1788483081.525142:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 171 00000100:00100000:0.0:1788483081.525153:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+17:12298:x1875360087096704:12345-192.168.206.54@tcp:101:stat.0 00010000:00010000:0.0:1788483081.525178:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483081.525197:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b0eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e498 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525281:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525294:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525304:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525317:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525324:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525330:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525399:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525410:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525418:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525451:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483081.525475:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 18 pid: 6493 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483081.525489:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c447d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098701440:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483081.525580:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788483081.528879:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483081.528998:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087096960 00000100:00100000:3.0:1788483081.529006:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087096960 00000100:00100000:3.0:1788483081.529059:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:3.0:1788483081.529069:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:6164:x1875360087096960:12345-192.168.206.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788483081.529371:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:6164:x1875360087096960:12345-192.168.206.54@tcp:35:ldlm_bl.0 Request processed in 302us (511us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788483081.529379:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:0.0:1788483081.530092:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c447d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098701440:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483081.530139:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483081.534826:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483081.534961:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087097088 00000100:00100000:3.0:1788483081.534971:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087097088 00010000:00010000:3.0:1788483081.535012:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 20 pid: 6493 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483081.535054:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 85 00000100:00100000:3.0:1788483081.535064:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:2392:x1875360087097088:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483081.535079:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483081.535086:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 20 pid: 6493 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.535138:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 20 pid: 6493 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.535178:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b0c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e48a expref: 20 pid: 6493 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.535205:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483081.535210:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.535219:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.535226:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483081.535247:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483081.535297:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:2392:x1875360087097088:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 234us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483081.535305:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 85 00010000:00010000:2.0:1788483081.535471:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535480:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483081.535533:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788483081.535537:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483081.535562:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535575:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535584:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535591:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535604:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535610:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483081.535614:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535621:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535631:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483081.535634:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483081.535637:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535643:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b0f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535653:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535659:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535665:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535670:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483081.535673:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535688:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535696:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a68c3183b00) 00010000:00010000:2.0:1788483081.535698:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483081.535701:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535708:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b0f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535742:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b0eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e498 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535769:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e498 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.535777:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483081.535780:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483081.535782:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9000, rc 0) 00000100:00100000:2.0:1788483081.535822:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:12298:x1875360087096704:12345-192.168.206.54@tcp:101:stat.0 Request processed in 10671us (11036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483081.535830:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 171 00000100:00100000:1.0:1788483081.622090:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483081.622285:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087097344 00000100:00100000:2.0:1788483081.622295:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087097344 00000100:00100000:2.0:1788483081.622358:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 172 00000100:00100000:2.0:1788483081.622369:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:12304:x1875360087097344:12345-192.168.206.54@tcp:36:truncate.0 00010000:00010000:2.0:1788483081.622436:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483081.622460:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e498 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.622480:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483081.622484:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483081.622646:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.622660:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.622670:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483081.622710:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788483081.622730:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007aba6cb5 reply state 0000000010e9d77d transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.622742:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.622764:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483081.622766:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483081.622769:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483081.622865:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:12304:x1875360087097344:12345-192.168.206.54@tcp:36:truncate.0 Request processed in 496us (781us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788483081.622873:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 172 00000020:00080000:2.0:1788483081.622878:0:8434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788483081.724779:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483081.725015:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087097472 00000100:00100000:2.0:1788483081.725036:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087097472 00000100:00100000:2.0:1788483081.725123:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 173 00000100:00100000:2.0:1788483081.725135:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:12318:x1875360087097472:12345-192.168.206.54@tcp:101:stat.0 00010000:00010000:2.0:1788483081.725159:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483081.725179:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b10e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e49f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725264:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725278:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725289:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725304:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725311:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725318:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725398:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725407:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725414:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483081.725458:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788483081.725462:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483081.725479:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725490:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725497:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725503:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725510:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725515:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483081.725520:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725527:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725539:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483081.725541:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483081.725546:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725551:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b115 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725571:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725577:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725582:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725587:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483081.725590:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725596:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725602:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69e24b6f00) 00010000:00010000:2.0:1788483081.725604:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483081.725606:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725612:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b11c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725640:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b10e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725652:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.725668:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483081.725671:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483081.725673:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:2.0:1788483081.725738:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12318:x1875360087097472:12345-192.168.206.54@tcp:101:stat.0 Request processed in 605us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483081.725756:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 173 00000100:00100000:1.0:1788483081.880682:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483081.880794:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087097728 00000100:00100000:2.0:1788483081.880804:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087097728 00000100:00100000:2.0:1788483081.880863:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 174 00000100:00100000:2.0:1788483081.880873:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12328:x1875360087097728:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483081.880893:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483081.880911:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b12a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4a6 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483081.880999:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788483081.881087:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b12a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4a6 expref: 23 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.881134:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:2.0:1788483081.881138:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483081.881143:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b12a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4a6 expref: 23 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483081.881157:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0031200, rc 0) 00000100:00100000:2.0:1788483081.881218:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:12328:x1875360087097728:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 347us (545us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1788483081.881241:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 174 00000100:00100000:1.0:1788483081.887075:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483081.887220:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087097984 00000100:00100000:3.0:1788483081.887230:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087097984 00000100:00100000:3.0:1788483081.887290:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:3.0:1788483081.887300:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4620850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:12328:x1875360087097984:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483081.887562:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4620850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:12328:x1875360087097984:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 261us (494us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788483081.887569:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:2.0:1788483081.976295:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483081.976319:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098701568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483081.976415:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483081.977269:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098701568 00000100:00100000:3.0:1788483081.977279:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098701568 00000100:00100000:3.0:1788483081.977338:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788483081.977347:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098701568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788483081.977380:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788483081.977435:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098701568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483081.977442:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788483081.977464:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483081.977474:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098701696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483081.977505:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483081.977541:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098701696 00000100:00100000:3.0:1788483081.977546:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098701696 00000100:00100000:3.0:1788483081.977569:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788483081.977575:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875360098701696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483081.977594:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483081.977625:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875360098701696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483081.977631:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788483081.977669:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098701696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483081.978368:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098701568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483081.978390:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483081.978398:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098701824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483081.978430:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483081.978531:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098701824 00000100:00100000:1.0:1788483081.978537:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098701824 00000100:00100000:1.0:1788483081.978577:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788483081.978584:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098701824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788483081.978597:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483081.978641:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098701824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483081.978648:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788483081.978765:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098701824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483082.043051:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483082.043172:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087098240 00000100:00100000:2.0:1788483082.043182:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087098240 00000100:00100000:2.0:1788483082.043252:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 175 00000100:00100000:2.0:1788483082.043263:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:12334:x1875360087098240:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483082.043290:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483082.043311:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b138 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.043443:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.043460:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.043469:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.043527:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.043540:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 24 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483082.043554:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098701952:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483082.044090:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483082.056946:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483082.057066:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098701952:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483082.057092:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483082.057184:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087098368 00000100:00100000:3.0:1788483082.057295:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087098368 00010000:00010000:3.0:1788483082.057336:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 25 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483082.057374:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 86 00000100:00100000:3.0:1788483082.057383:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:2393:x1875360087098368:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483082.057397:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483082.057416:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 25 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.057428:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 25 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.057451:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b123 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e49f expref: 25 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.057466:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483082.057471:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.057481:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.057488:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.057593:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483082.057644:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:2393:x1875360087098368:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 261us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483082.057651:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 86 00010000:00010000:2.0:1788483082.058010:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.058018:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483082.058035:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788483082.058396:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b138 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.058412:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.058419:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483082.058422:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483082.058434:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77c00, rc 0) 00000100:00100000:2.0:1788483082.058515:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:12334:x1875360087098240:12345-192.168.206.54@tcp:101:bash.0 Request processed in 15254us (15474us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788483082.058523:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 175 00000100:00100000:1.0:1788483082.066659:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483082.066738:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087098624 00000100:00100000:2.0:1788483082.066762:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087098624 00000100:00100000:2.0:1788483082.066833:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 176 00000100:00100000:2.0:1788483082.066845:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:12334:x1875360087098624:12345-192.168.206.54@tcp:36:bash.0 00010000:00010000:2.0:1788483082.067072:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.067090:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.067815:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483082.067870:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788483082.067897:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4132a89 reply state 000000004101b55e transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.068028:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483082.068035:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483082.068037:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483082.068040:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483082.068154:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12334:x1875360087098624:12345-192.168.206.54@tcp:36:bash.0 Request processed in 1310us (1504us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788483082.068160:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 176 00000020:00080000:2.0:1788483082.068176:0:8434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788483082.078399:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483082.078518:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087098752 00000100:00100000:0.0:1788483082.078527:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087098752 00000100:00100000:0.0:1788483082.078590:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 177 00000100:00100000:0.0:1788483082.078601:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12334:x1875360087098752:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483082.078626:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483082.078652:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b154 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4b4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.078755:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.078770:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.078779:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.078812:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.078838:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 28 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483082.078853:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c447f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098702080:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483082.080398:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788483082.085050:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483082.085240:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087098880 00000100:00100000:3.0:1788483082.085249:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087098880 00010000:00010000:3.0:1788483082.085302:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 29 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483082.085356:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 87 00000100:00100000:3.0:1788483082.085367:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:2392:x1875360087098880:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483082.085401:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483082.085410:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 29 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.085424:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 29 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.085449:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b13f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ad expref: 29 pid: 6493 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.085467:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483082.085473:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.085484:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.085493:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.085513:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483082.085627:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:2392:x1875360087098880:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 262us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483082.085633:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 87 00000100:00100000:0.0:1788483082.085873:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c447f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098702080:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483082.085902:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.085913:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.085920:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483082.085986:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788483082.085992:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483082.086017:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.086059:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b154 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4b4 expref: 28 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.086076:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4b4 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.086084:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:0.0:1788483082.086172:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483082.086176:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9800, rc 0) 00000100:00100000:0.0:1788483082.086231:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12334:x1875360087098752:12345-192.168.206.54@tcp:101:bash.0 Request processed in 7632us (7842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483082.086239:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 177 00000100:00100000:1.0:1788483082.090958:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483082.091173:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087099136 00000100:00100000:3.0:1788483082.091183:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087099136 00000100:00100000:3.0:1788483082.091240:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:3.0:1788483082.091261:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12334:x1875360087099136:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:3.0:1788483082.091502:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:12334:x1875360087099136:12345-192.168.206.54@tcp:35:bash.0 Request processed in 252us (551us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788483082.091511:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:3.0:1788483082.155487:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483082.155594:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087099392 00000100:00100000:0.0:1788483082.155613:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087099392 00000100:00100000:0.0:1788483082.155700:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 178 00000100:00100000:0.0:1788483082.155710:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:12344:x1875360087099392:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483082.155894:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483082.155925:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4bb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483082.156055:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788483082.156323:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b162 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4bb expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.156339:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:1.0:1788483082.156341:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788483082.156345:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4bb expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.156358:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8a00, rc 0) 00000100:00100000:1.0:1788483082.156440:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:12344:x1875360087099392:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 729us (961us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788483082.156447:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 178 00000100:00100000:2.0:1788483082.159369:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483082.159489:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087099520 00000100:00100000:1.0:1788483082.161059:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087099520 00000100:00100000:1.0:1788483082.162297:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 179 00000100:00100000:1.0:1788483082.162322:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:12344:x1875360087099520:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:1.0:1788483082.162589:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.162611:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.162626:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.162658:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.162664:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.162668:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.162890:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163027:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163038:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483082.163136:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163154:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163162:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163170:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163177:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483082.163182:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163201:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163218:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483082.163221:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483082.163227:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163234:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b170 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163252:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163259:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163265:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163270:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483082.163273:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163279:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163287:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69f63d2f00) 00010000:00010000:1.0:1788483082.163290:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483082.163293:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163312:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163333:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163339:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163345:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163350:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483082.163352:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163358:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163366:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483082.163369:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483082.163371:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.163377:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b17e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483082.163799:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:12344:x1875360087099520:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 1481us (4437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483082.163811:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 179 00000100:00100000:3.0:1788483082.168616:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483082.169068:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087099776 00000100:00100000:0.0:1788483082.169082:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087099776 00000100:00100000:0.0:1788483082.169438:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:0.0:1788483082.169450:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:12344:x1875360087099776:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:0.0:1788483082.171525:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:12344:x1875360087099776:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 2058us (2905us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788483082.171540:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:2.0:1788483082.215733:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483082.215901:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087100032 00000100:00100000:1.0:1788483082.215914:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087100032 00000100:00100000:1.0:1788483082.215996:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 180 00000100:00100000:1.0:1788483082.216007:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:12347:x1875360087100032:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:1.0:1788483082.216038:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483082.216064:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b185 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4c2 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216242:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216259:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216273:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216291:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216299:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216305:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216444:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1b19a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216455:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1b19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216476:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1b19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483082.216487:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788483082.216589:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216598:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216606:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216612:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483082.216616:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216625:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216640:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483082.216643:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483082.216649:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216655:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b18c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216672:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216678:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216691:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216697:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483082.216700:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216707:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216730:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69f63d2f00) 00010000:00010000:1.0:1788483082.216733:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483082.216736:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216752:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b193 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216802:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b185 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4c2 expref: 33 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216818:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1b19a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4c2 expref: 32 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.216827:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483082.216829:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483082.216832:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27800, rc 0) 00000100:00100000:1.0:1788483082.216912:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:12347:x1875360087100032:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 907us (1210us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788483082.216931:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 180 00000100:00100000:2.0:1788483082.220904:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483082.220957:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483082.221094:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087100288 00000100:00100000:1.0:1788483082.221143:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087100288 00000100:00100000:1.0:1788483082.221224:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:1.0:1788483082.221235:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:2393:x1875360087100288:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483082.221253:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483082.221282:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1b19a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4c2 expref: 32 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.221304:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483082.221310:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483082.221372:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+31:2393:x1875360087100288:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 139us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483082.221381:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:0.0:1788483082.221535:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087100160 00000100:00100000:0.0:1788483082.221541:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087100160 00000100:00100000:0.0:1788483082.221583:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 181 00000100:00100000:0.0:1788483082.221592:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+31:12347:x1875360087100160:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:0.0:1788483082.221662:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221689:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221700:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221753:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221761:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221768:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221775:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483082.221780:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221788:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221804:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:0.0:1788483082.221807:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483082.221810:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.221817:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b1a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483082.221858:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+31:12347:x1875360087100160:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 267us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483082.221871:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 181 00000100:00100000:0.0:1788483082.225722:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483082.225836:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087100544 00000100:00100000:3.0:1788483082.225848:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087100544 00000100:00100000:3.0:1788483082.225927:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:3.0:1788483082.225940:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+31:12347:x1875360087100544:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483082.226966:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:12347:x1875360087100544:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 1022us (1250us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788483082.226978:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 47 00010000:00010000:3.0:1788483082.360482:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483082.420633:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483082.420763:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087100800 00000100:00100000:1.0:1788483082.420777:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087100800 00000100:00100000:3.0:1788483082.420969:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 182 00000100:00100000:3.0:1788483082.420985:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:12365:x1875360087100800:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:3.0:1788483082.421019:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483082.422302:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4c9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.422458:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.422477:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.422492:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483082.422506:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788483082.424439:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4c9 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.424505:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4c9 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.424516:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483082.424519:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788483082.424524:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c1528000, rc 0) 00000100:00100000:3.0:1788483082.424731:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12365:x1875360087100800:12345-192.168.206.54@tcp:101:cat.0 Request processed in 3749us (4109us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788483082.424749:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 182 00000100:00100000:1.0:1788483082.458321:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483082.458626:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087100928 00000100:00100000:0.0:1788483082.458642:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087100928 00000100:00100000:0.0:1788483082.458738:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 183 00000100:00100000:0.0:1788483082.458766:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12366:x1875360087100928:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483082.458796:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483082.458822:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b1c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4d0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.458917:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b1cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.458933:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.458945:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483082.458997:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788483082.459001:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483082.459021:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.459055:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b1c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d0 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.459077:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d0 expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483082.459173:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:0.0:1788483082.459176:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483082.459179:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8800, rc 0) 00000100:00100000:0.0:1788483082.459279:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12366:x1875360087100928:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 515us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483082.459286:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 183 00000100:00100000:0.0:1788483082.473635:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483082.473810:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087101312 00000100:00100000:2.0:1788483082.473825:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087101312 00000100:00100000:2.0:1788483082.473922:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 48 00000100:00100000:2.0:1788483082.473935:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12366:x1875360087101312:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483082.474567:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12366:x1875360087101312:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 630us (954us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788483082.474579:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 48 00000100:00100000:2.0:1788483082.478671:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483082.478995:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087101440 00000100:00100000:3.0:1788483082.479009:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087101440 00000100:00100000:3.0:1788483082.479188:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:3.0:1788483082.479211:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12366:x1875360087101440:12345-192.168.206.54@tcp:103:lfs.0 00010000:00010000:3.0:1788483082.479230:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788483082.479258:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b15b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4b4 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.479284:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4c9 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.479298:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e46e expref: 34 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.479310:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483082.479316:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483082.479393:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:12366:x1875360087101440:12345-192.168.206.54@tcp:103:lfs.0 Request processed in 194us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483082.479401:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:1.0:1788483082.483071:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483082.483279:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087101568 00000100:00100000:3.0:1788483082.483293:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087101568 00000100:00100000:3.0:1788483082.483371:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 184 00000100:00100000:3.0:1788483082.483383:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:12366:x1875360087101568:12345-192.168.206.54@tcp:58:lfs.0 00010000:00010000:3.0:1788483082.483554:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.483581:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483082.483595:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483082.484083:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788483082.484391:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:12366:x1875360087101568:12345-192.168.206.54@tcp:58:lfs.0 Request processed in 1007us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483082.484402:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 184 00000100:00100000:0.0:1788483082.515799:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483082.516190:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087101696 00000100:00100000:1.0:1788483082.516214:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087101696 00000100:00100000:1.0:1788483082.516283:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 185 00000100:00100000:1.0:1788483082.516294:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+33:12368:x1875360087101696:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:1.0:1788483082.516321:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483082.516350:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b1d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516463:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516480:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516493:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516508:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516516:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516523:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516625:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516637:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516644:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483082.516697:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788483082.516702:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483082.516752:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516778:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516788:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516795:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516802:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516809:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483082.516814:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516823:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516837:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483082.516841:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483082.516846:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516853:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b1e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516881:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516888:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516901:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516907:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483082.516910:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516917:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516927:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69f63d2f00) 00010000:00010000:1.0:1788483082.516929:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483082.516933:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516938:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b1e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516977:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b1d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.516992:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 34 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483082.517000:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:1.0:1788483082.517003:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483082.517006:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26400, rc 0) 00000100:00100000:1.0:1788483082.517146:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12368:x1875360087101696:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 852us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483082.517164:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 185 00010000:00010000:3.0:1788483083.384842:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483083.413043:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.413136:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483083.413150:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087101824 00000100:00100000:2.0:1788483083.413160:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087101824 00000100:00100000:0.0:1788483083.413163:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.413185:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.413204:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483083.413221:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 393 00000100:00100000:0.0:1788483083.413221:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483083.413230:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087101824:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483083.413261:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.413284:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087102336 00000100:00100000:0.0:1788483083.413288:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087102336 00000100:00100000:2.0:1788483083.413304:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2393:x1875360087101824:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.413312:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 393 00000100:00100000:0.0:1788483083.413320:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087102208 00000100:00100000:0.0:1788483083.413322:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087102208 00000100:00100000:0.0:1788483083.413340:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 147 00000100:00100000:0.0:1788483083.413347:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087102336:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483083.413374:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2393:x1875360087102336:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483083.413380:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 147 00000100:00100000:0.0:1788483083.413392:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00100000:0.0:1788483083.413410:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087102208:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483083.413436:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087102208:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483083.413442:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00100000:0.0:1788483083.413460:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087102080 00000100:00100000:0.0:1788483083.413464:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087102080 00000100:00100000:0.0:1788483083.413483:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087102592 00000100:00100000:0.0:1788483083.413486:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087102592 00000100:00100000:2.0:1788483083.413494:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087101952 00000100:00100000:0.0:1788483083.413497:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087102464 00000100:00100000:2.0:1788483083.413498:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087101952 00000100:00100000:0.0:1788483083.413499:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087102464 00000100:00100000:0.0:1788483083.413513:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 335 00000100:00100000:0.0:1788483083.413518:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087102080:12345-192.168.206.54@tcp:400:kworker.0 00000100:00080000:1.0:1788483083.413871:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483083.413875:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483083.413877:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483083.413880:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483083.414728:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2393:x1875360087102080:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 1205us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.416934:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 336 00000100:00100000:2.0:1788483083.416970:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087102592:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483083.417044:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087102592:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 84us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.417052:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 336 00000100:00100000:2.0:1788483083.417085:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 337 00000100:00100000:2.0:1788483083.417118:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087102464:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483083.417146:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2393:x1875360087102464:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 55us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.417153:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 337 00000100:00100000:2.0:1788483083.417165:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 338 00000100:00100000:2.0:1788483083.417171:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:2393:x1875360087101952:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483083.417194:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:2393:x1875360087101952:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.417200:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 338 00000100:00100000:1.0:1788483083.430215:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 335 00000040:00080000:3.0:1788483083.452007:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483083.452022:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483083.452058:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788483083.452067:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788483083.452306:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3fad880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098702208:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788483083.452441:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9588780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483083.465855:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3fad880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098702208:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788483083.476004:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483083.476083:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087102720 00000100:00100000:1.0:1788483083.476125:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087102720 00000100:00100000:1.0:1788483083.476208:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 186 00000100:00100000:1.0:1788483083.476220:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12379:x1875360087102720:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483083.476259:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788483083.490649:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12379:x1875360087102720:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 14415us (14637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483083.490668:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 186 00000100:00100000:0.0:1788483083.495601:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.495675:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087102848 00000100:00100000:3.0:1788483083.495691:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087102848 00000100:00100000:3.0:1788483083.495811:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 187 00000100:00100000:3.0:1788483083.495823:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12379:x1875360087102848:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788483083.495889:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.495905:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.495917:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.495931:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.495939:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.495946:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.495986:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.495996:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496003:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483083.496046:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788483083.496050:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483083.496062:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496081:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496088:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496130:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496138:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483083.496142:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496151:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496163:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:3.0:1788483083.496166:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483083.496170:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496177:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529800/0x1d7ea3d89ea1b1f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496191:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496197:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496202:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496213:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483083.496216:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496221:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496229:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9a68c1c53c00) 00010000:00010000:3.0:1788483083.496231:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483083.496445:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496451:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1528000/0x1d7ea3d89ea1b1fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496468:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496475:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496481:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496486:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483083.496489:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496496:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496516:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483083.496519:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483083.496522:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.496527:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0031200/0x1d7ea3d89ea1b203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483083.498386:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12379:x1875360087102848:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 Request processed in 2556us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.498400:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 187 00000100:00100000:2.0:1788483083.505501:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.505836:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087103104 00000100:00100000:3.0:1788483083.505845:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087103104 00000100:00100000:3.0:1788483083.505909:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 188 00000100:00100000:3.0:1788483083.505920:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:12379:x1875360087103104:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483083.505939:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483083.505957:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b20a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4de expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506057:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506072:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506084:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483083.506121:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788483083.506207:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506215:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506222:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506227:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483083.506241:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506248:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506261:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483083.506264:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483083.506269:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506275:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506327:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b20a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4de expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506342:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:3.0:1788483083.506344:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483083.506351:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c0030400/0x1d7ea3d89ea1b20a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4de expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.506374:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c0030400, rc 0) 00000100:00100000:3.0:1788483083.506436:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12379:x1875360087103104:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 516us (942us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788483083.506446:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 188 00000100:00100000:3.0:1788483083.525609:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.525648:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087103232 00000100:00100000:3.0:1788483083.525657:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087103232 00000100:00100000:3.0:1788483083.525704:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 189 00000100:00100000:3.0:1788483083.525727:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12379:x1875360087103232:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788483083.525771:0:8434:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788483083.525883:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12379:x1875360087103232:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 158us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.525891:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 189 00000100:00100000:3.0:1788483083.530949:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.531062:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087103488 00000100:00100000:0.0:1788483083.531077:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087103488 00000100:00100000:0.0:1788483083.531179:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 190 00000100:00100000:0.0:1788483083.531197:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12379:x1875360087103488:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483083.531222:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483083.531225:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788483083.531257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b1cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d0 expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.531292:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:0.0:1788483083.531297:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483083.531311:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b21f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788483083.531924:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788483083.532163:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b226 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.532180:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.533337:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.537601:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b21f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4e5 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.537638:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4e5 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.537650:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c3183200) 00010000:00010000:2.0:1788483083.537654:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483083.537657:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8600, rc 0) 00000100:00100000:2.0:1788483083.537777:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12379:x1875360087103488:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 6587us (6835us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788483083.537801:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 190 00000100:00100000:0.0:1788483083.560613:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483083.563474:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087103744 00000100:00100000:1.0:1788483083.563495:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087103744 00000100:00100000:1.0:1788483083.563584:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 191 00000100:00100000:1.0:1788483083.563596:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12379:x1875360087103744:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483083.563668:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483083.563704:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4e5 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.563744:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c3183200) 00010000:00010000:1.0:1788483083.563760:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483083.563788:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.563804:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.563828:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564046:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564068:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564080:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564178:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564186:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564346:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564353:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483083.564357:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564365:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564378:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483083.564382:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483083.564386:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564406:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b234 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564423:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564431:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564437:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564443:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483083.564446:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564453:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564461:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8659493b (ffff9a69f63d2f00) 00010000:00010000:1.0:1788483083.564464:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483083.564467:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.564474:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b23b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8659493b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483083.564575:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12379:x1875360087103744:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 975us (3970us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788483083.564585:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 191 00000100:00100000:0.0:1788483083.574881:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.575341:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087103872 00000100:00100000:3.0:1788483083.575354:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087103872 00000100:00100000:3.0:1788483083.575431:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 192 00000100:00100000:3.0:1788483083.575442:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12379:x1875360087103872:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483083.575468:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483083.575497:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4ec expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.575542:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.575578:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.575593:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.575754:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 37 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.575779:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 36 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.575788:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:3.0:1788483083.575792:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483083.575796:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3c00, rc 0) 00000100:00100000:3.0:1788483083.576316:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12379:x1875360087103872:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 871us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.576325:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 192 00000100:00100000:0.0:1788483083.587793:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.588152:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087104128 00000100:00100000:3.0:1788483083.588166:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087104128 00000100:00100000:3.0:1788483083.588250:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 193 00000100:00100000:3.0:1788483083.588262:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+36:12379:x1875360087104128:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788483083.588366:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.588397:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.588431:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483083.588640:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788483083.588651:0:8434:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375851554182ns, next at 376851551274ns, rc = 0 00000004:00010000:3.0:1788483083.588709:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa242fe2 reply state 000000007ccbd2d5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.588722:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.588730:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:3.0:1788483083.588732:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788483083.588747:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483083.588885:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:12379:x1875360087104128:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 624us (1104us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788483083.588894:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 193 00000100:00100000:0.0:1788483083.593636:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.593844:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087104256 00000100:00100000:3.0:1788483083.593929:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087104256 00000100:00100000:3.0:1788483083.594008:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 194 00000100:00100000:3.0:1788483083.594021:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:12379:x1875360087104256:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483083.594052:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483083.594076:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.594187:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.594346:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.594372:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:3.0:1788483083.594444:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483083.594450:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2e00, rc 0) 00000100:00100000:3.0:1788483083.594565:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:12379:x1875360087104256:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 545us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.594573:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 194 00000100:00100000:1.0:1788483083.615506:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.615561:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087104384 00000100:00100000:0.0:1788483083.615571:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087104384 00000100:00100000:0.0:1788483083.615641:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:0.0:1788483083.615653:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087104384:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788483083.615916:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087104384:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 255us (409us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788483083.615929:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:3.0:1788483083.631453:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.633213:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087104640 00000100:00100000:0.0:1788483083.633236:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087104640 00000100:00100000:0.0:1788483083.633307:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00100000:0.0:1788483083.633319:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:12379:x1875360087104640:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788483083.633568:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12379:x1875360087104640:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 250us (2128us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788483083.633578:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00100000:2.0:1788483083.648221:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.649380:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087104896 00000100:00100000:3.0:1788483083.649399:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087104896 00000100:00100000:3.0:1788483083.649492:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 195 00000100:00100000:3.0:1788483083.649506:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12379:x1875360087104896:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788483083.649657:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12379:x1875360087104896:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 152us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.649665:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 195 00000100:00100000:1.0:1788483083.654591:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483083.655426:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087105024 00000100:00100000:2.0:1788483083.655438:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087105024 00000100:00100000:2.0:1788483083.655505:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 196 00000100:00100000:2.0:1788483083.655515:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12379:x1875360087105024:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483083.655535:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483083.655560:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b25e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e4fa expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.655918:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b265 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.655932:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.655943:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483083.655984:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483083.656003:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.656031:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b25e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4fa expref: 42 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.656045:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4fa expref: 41 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483083.656066:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:2.0:1788483083.656069:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788483083.656073:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77200, rc 0) 00000100:00100000:2.0:1788483083.656164:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12379:x1875360087105024:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 650us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.656172:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 196 00000100:00100000:2.0:1788483083.677432:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483083.677791:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087105152 00000100:00100000:1.0:1788483083.677800:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087105152 00000100:00100000:1.0:1788483083.677939:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:1.0:1788483083.677951:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087105152:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483083.677967:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483083.677988:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e501 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483083.678012:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a160a, blocks: 0x0 00010000:00010000:1.0:1788483083.678031:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1788483083.678036:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483083.678044:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.678061:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.678074:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27600, rc 0) 00000100:00100000:1.0:1788483083.678156:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087105152:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 207us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483083.678164:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:0.0:1788483083.692389:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.692546:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087105408 00000100:00100000:3.0:1788483083.692560:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087105408 00000100:00100000:3.0:1788483083.692640:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 197 00000100:00100000:3.0:1788483083.692653:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c447d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12379:x1875360087105408:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788483083.692804:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c447d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12379:x1875360087105408:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 152us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.692814:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 197 00000100:00100000:1.0:1788483083.704701:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.704961:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087105536 00000100:00100000:0.0:1788483083.704978:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087105536 00000100:00100000:0.0:1788483083.705052:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:0.0:1788483083.705063:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:12379:x1875360087105536:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483083.705086:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483083.705131:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e508 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.705173:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 9 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.705184:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483083.705190:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483083.705199:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.705319:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 9 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.705361:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 9 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483083.705380:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098702336:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483083.705471:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483083.738167:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.738403:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087105664 00000100:00100000:0.0:1788483083.738417:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087105664 00010000:00010000:0.0:1788483083.738466:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 10 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483083.738540:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 88 00000100:00100000:0.0:1788483083.738552:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:2393:x1875360087105664:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483083.738578:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483083.738601:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 10 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.738617:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 10 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.738644:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788483083.738649:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483083.738657:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 10 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.738667:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 10 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.738721:0:7436:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 10 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483083.738748:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7436:1875360098702464:192.168.206.54@tcp:105: 00000100:00100000:0.0:1788483083.738838:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d9a69600 going to sleep for 11 seconds 00010000:00010000:1.0:1788483083.741146:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2acb469/0x1d7ea3d89ea1b26c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e501 expref: 10 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483083.741167:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098702336:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483083.741195:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.741424:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:1.0:1788483083.741488:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:12379:x1875360087105536:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 36425us (36796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483083.741496:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:2.0:1788483083.763541:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7436:1875360098702464:192.168.206.54@tcp:105: 00010000:00010000:2.0:1788483083.763581:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483083.763657:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087105664:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 25107us (25503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.763669:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 88 00000100:00100000:2.0:1788483083.763809:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.764175:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087105792 00000100:00100000:3.0:1788483083.764186:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087105792 00002000:00100000:3.0:1788483083.764564:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a68c3f9f480 x1875360087105792/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:589/0 lens 504/0 e 0 to 0 dl 1788483094 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788483083.764576:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c3f9f480 with x1875360087105792 ext(0->8) 00002000:00010000:3.0:1788483083.764583:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68c3f9f480 00000100:00100000:3.0:1788483083.764725:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:3.0:1788483083.764748:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087105792:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788483083.766808:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:2393:x1875360087105792:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 Request processed in 2062us (2989us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788483083.766822:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 00002000:00100000:3.0:1788483083.766835:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a68c3f9f480 x1875360087105792/t4294967315(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:589/0 lens 504/448 e 0 to 0 dl 1788483094 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788483083.766845:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c3f9f480 with x1875360087105792 ext(0->8) 00002000:00010000:3.0:1788483083.766852:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68c3f9f480 00000100:00100000:2.0:1788483083.789613:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483083.789670:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087105920 00000100:00100000:2.0:1788483083.789683:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087105920 00000100:00100000:2.0:1788483083.789761:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 198 00000100:00100000:2.0:1788483083.789774:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12379:x1875360087105920:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 00000040:00080000:2.0:1788483083.801940:0:14683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483083.801953:0:14683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483083.801983:0:14683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788483083.801991:0:14683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788483083.804973:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788483083.804990:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788483083.805042:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788483083.805294:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788483083.805305:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788483083.805312:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483083.805344:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098702592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788483083.805416:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483083.805471:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098702592 00000100:00100000:3.0:1788483083.805479:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098702592 00000100:00100000:3.0:1788483083.805530:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788483083.805538:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098702592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788483083.805656:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788483083.805660:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788483082 00002000:00010000:3.0:1788483083.805664:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788483083.805666:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788483082 -> 1788483082 00002000:00010000:3.0:1788483083.805679:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788483083.805790:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805807:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805815:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805822:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483083.805827:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805834:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805853:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:0.0:1788483083.805856:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483083.805861:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805867:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b107 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805883:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805889:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805895:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805900:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483083.805911:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805917:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805925:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:0.0:1788483083.805928:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483083.805930:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805936:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b14d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805947:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805954:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805959:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805975:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483083.805978:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805985:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.805993:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:0.0:1788483083.805995:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788483083.806003:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.806009:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b250 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788483083.810148:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483083.820622:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098702592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 15075us (15196us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788483083.820638:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788483083.825659:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:12379:x1875360087105920:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 Request processed in 35869us (36042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483083.825710:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 198 00000004:00080000:2.0:1788483083.828268:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69d0f17480/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788483083.828292:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098702592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788483083.852205:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.865537:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087106048 00000100:00100000:3.0:1788483083.865560:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087106048 00000100:00100000:2.0:1788483083.865836:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:2.0:1788483083.865850:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:2393:x1875360087106048:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788483083.877476:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788483083.877490:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788483083.877889:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087106048:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 Request processed in 12028us (25689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.877905:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:1.0:1788483083.890565:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.892312:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087106304 00000100:00100000:3.0:1788483083.892331:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087106304 00000100:00100000:3.0:1788483083.892539:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 199 00000100:00100000:3.0:1788483083.892554:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:12379:x1875360087106304:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788483083.892627:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483083.892664:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b265 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4fa expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.892688:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:3.0:1788483083.892694:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483083.894358:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.894461:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.894477:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483083.894661:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000239b8e7f reply state 00000000f5b951bb transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.894687:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.894695:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:3.0:1788483083.894698:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483083.894703:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483083.894869:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:12379:x1875360087106304:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 2314us (4315us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788483083.894878:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 199 00000100:00100000:0.0:1788483083.904576:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483083.905701:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087106432 00000100:00100000:1.0:1788483083.905727:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087106432 00000100:00100000:1.0:1788483083.905820:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:1.0:1788483083.905836:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087106432:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788483083.906041:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788483083.906046:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788483082 -> 1788483081 00002000:00010000:1.0:1788483083.906048:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788483079 00002000:00010000:1.0:1788483083.906051:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788483082 -> 1788483081 00002000:00010000:1.0:1788483083.906053:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788483083.906160:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087106432:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 328us (1591us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788483083.906171:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:0.0:1788483083.924270:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483083.926721:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087106688 00000100:00100000:3.0:1788483083.926766:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087106688 00000100:00100000:3.0:1788483083.927535:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 200 00000100:00100000:3.0:1788483083.927550:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:12379:x1875360087106688:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788483083.927761:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.927851:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.927863:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.927908:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.927924:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 20 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483083.928304:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c376ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098702720:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483083.928437:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483083.941710:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483083.941751:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087106816 00000100:00100000:1.0:1788483083.941760:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087106816 00010000:00010000:1.0:1788483083.941799:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 21 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483083.941834:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 89 00000100:00100000:1.0:1788483083.941844:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:2393:x1875360087106816:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483083.941858:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483083.941865:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 21 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.941879:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 21 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.941901:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:1.0:1788483083.941924:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.941934:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.941941:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483083.941964:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483083.942011:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:2393:x1875360087106816:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 168us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483083.942019:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 89 00010000:00010000:0.0:1788483083.942420:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b249 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4ec expref: 20 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483083.942435:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c376ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098702720:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483083.942454:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942462:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942467:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942500:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942507:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942514:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942520:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483083.942532:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942539:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942549:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:0.0:1788483083.942552:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788483083.942556:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.942562:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b281 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483083.943554:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:12379:x1875360087106688:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 Request processed in 16003us (19300us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788483083.943565:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 200 00000100:00100000:3.0:1788483083.964160:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.964395:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087106944 00000100:00100000:0.0:1788483083.964405:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087106944 00000100:00100000:0.0:1788483083.964462:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:0.0:1788483083.964472:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2393:x1875360087106944:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788483083.964511:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.964531:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.964540:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483083.964544:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483083.964559:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.964609:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.964626:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 8 pid: 8412 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483083.964641:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098702848:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483083.965066:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d9a69300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483083.985384:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098702848:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483083.985412:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483083.987728:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483083.988505:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087107072 00000100:00100000:0.0:1788483083.988515:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087107072 00010000:00010000:0.0:1788483083.988556:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 9 pid: 8412 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483083.988591:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 90 00000100:00100000:0.0:1788483083.988615:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087107072:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483083.988629:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483083.988649:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 9 pid: 8412 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.988680:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 9 pid: 8412 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.988714:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fb91a2/0x1d7ea3d89ea1b273 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e508 expref: 9 pid: 8412 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.990407:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483083.990417:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483083.990425:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.990439:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483083.990539:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483083.990617:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087107072:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 1999us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483083.990627:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 90 00010000:00010000:3.0:1788483083.991935:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.991949:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.991975:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.991983:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.991990:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.991997:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483083.992001:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.992010:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.992045:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483083.992053:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b288 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483083.992155:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087106944:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 Request processed in 27681us (28001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483083.992163:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:0.0:1788483084.000439:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483084.000554:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087107328 00000100:00100000:3.0:1788483084.000562:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087107328 00000100:00100000:3.0:1788483084.000621:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 201 00000100:00100000:3.0:1788483084.000631:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:12379:x1875360087107328:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788483084.000699:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.000714:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.000723:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.000782:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.000795:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 19 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483084.000813:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098702976:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483084.000880:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788483084.005789:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098702976:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483084.005818:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483084.006561:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483084.006865:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087107456 00000100:00100000:2.0:1788483084.006874:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087107456 00010000:00010000:2.0:1788483084.006914:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 20 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483084.006957:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 91 00000100:00100000:2.0:1788483084.006967:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:2392:x1875360087107456:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483084.006982:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483084.006989:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 20 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007003:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 20 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007026:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529400/0x1d7ea3d89ea1b0d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e491 expref: 20 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007056:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483084.007061:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007070:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007078:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007128:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483084.007180:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:2392:x1875360087107456:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 214us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483084.007188:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 91 00010000:00010000:2.0:1788483084.007296:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007304:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007686:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007698:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007721:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007760:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.007781:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 19 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483084.007795:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098703104:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483084.007848:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483084.011383:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483084.011641:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087107584 00000100:00100000:1.0:1788483084.011650:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087107584 00010000:00010000:1.0:1788483084.011690:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 20 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483084.011749:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 92 00000100:00100000:1.0:1788483084.011768:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:2393:x1875360087107584:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483084.011781:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483084.011788:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 20 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483084.011801:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 20 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483084.011822:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:1.0:1788483084.011827:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483084.011846:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483084.011854:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483084.011874:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483084.011922:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:2393:x1875360087107584:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 164us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483084.011929:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 92 00010000:00010000:2.0:1788483084.012651:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b257 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4f3 expref: 19 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483084.012671:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098703104:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483084.012694:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.012702:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.012720:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483084.012839:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788483084.012954:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788483084.012992:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788483084.013066:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098703232:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788483084.013140:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483084.013163:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483084.014010:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098703232 00000100:00100000:1.0:1788483084.014019:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098703232 00000100:00100000:1.0:1788483084.014079:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788483084.014088:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8434:x1875360098703232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788483084.014203:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8434:x1875360098703232:12345-0@lo:1000:mdt00_003.0 Request processed in 115us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483084.014211:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788483084.016633:0:8434:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788483084.016644:0:8434:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69d0f17480, transno 4294967316 00000100:00100000:2.0:1788483084.016666:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098703232:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788483084.016851:0:8434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788483084.016921:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098703360:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788483084.016976:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483084.017004:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788483084.017371:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098703360 00000100:00100000:3.0:1788483084.017521:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098703360 00000100:00100000:3.0:1788483084.017577:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788483084.017586:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8434:x1875360098703360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788483084.017936:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8434:x1875360098703360:12345-0@lo:1000:mdt00_003.0 Request processed in 350us (959us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788483084.017944:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788483084.018092:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8434:1875360098703360:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788483084.018954:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.018965:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.018972:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.018978:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483084.018982:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.018989:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019004:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:2.0:1788483084.019007:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483084.019012:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019018:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6200/0x1d7ea3d89ea1b296 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019042:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019057:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019063:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019068:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1529000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483084.019071:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019077:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019085:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:2.0:1788483084.019087:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483084.019090:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483084.019685:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529000/0x1d7ea3d89ea1b1d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.020953:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.020975:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.020985:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.021033:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.021046:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 22 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483084.021060:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098703488:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483084.021166:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d9a69300 going to sleep for 11 seconds 00000100:00100000:3.0:1788483084.024259:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483084.024688:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098703488:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483084.024723:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483084.025170:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087107712 00000100:00100000:3.0:1788483084.025179:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087107712 00010000:00010000:3.0:1788483084.025215:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 23 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483084.025255:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 93 00000100:00100000:3.0:1788483084.025265:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:2392:x1875360087107712:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483084.025278:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483084.025285:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 23 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.025309:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 23 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.025333:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b1ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e4d7 expref: 23 pid: 6495 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.025347:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:3.0:1788483084.025360:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.025369:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.025384:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483084.025406:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483084.025459:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:2392:x1875360087107712:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 195us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483084.025467:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 93 00010000:00010000:0.0:1788483084.025816:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025824:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025836:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025843:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025850:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025856:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483084.025860:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025875:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025885:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:0.0:1788483084.025888:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483084.025891:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025897:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b29d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025908:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025915:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025921:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025926:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483084.025929:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025935:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025942:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c1c53e00) 00010000:00010000:0.0:1788483084.025944:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483084.025947:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.025963:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b28f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483084.026126:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12379:x1875360087107328:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 25494us (25693us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788483084.026135:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 201 00000020:00080000:0.0:1788483084.026138:0:8434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788483084.026966:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483084.026971:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483084.028183:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788483084.028196:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483084.031933:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483084.032526:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087107968 00000100:00100000:0.0:1788483084.032535:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087107968 00000100:00100000:0.0:1788483084.032606:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:0.0:1788483084.032616:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4622450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12379:x1875360087107968:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788483084.032872:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788483084.032905:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788483084.032939:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.032954:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.032965:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.032973:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.032979:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.032985:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.033012:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788483084.033122:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4622450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:12379:x1875360087107968:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 483us (1174us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788483084.033130:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 50 00000020:00080000:0.0:1788483084.033135:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788483084.033187:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483084.033193:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.033200:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483084.033205:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.033212:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.033225:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:0.0:1788483084.033228:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788483084.033232:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.033237:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483084.033259:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483084.033262:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483084.033263:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483084.408422:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483084.536598:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483084.536622:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098703616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483084.536689:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483084.539158:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098703616 00000100:00100000:1.0:1788483084.539171:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098703616 00000100:00100000:1.0:1788483084.539251:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788483084.539261:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098703616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483084.539296:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788483084.539379:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098703616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483084.539386:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788483084.539789:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098703616:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483085.432305:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483085.562226:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098703872:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562289:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483085.562301:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483085.562332:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483085.562352:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098704256:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562355:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098704384:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562375:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562379:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483085.562391:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098704768:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562392:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098704896:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562411:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562419:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704256 00000100:00100000:0.0:1788483085.562425:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704256 00000100:00100000:2.0:1788483085.562437:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098705280:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562458:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562466:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788483085.562474:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098704256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562482:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098704000:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562503:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562517:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098704256:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483085.562518:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098704512:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562524:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788483085.562537:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562538:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704000 00000100:00100000:0.0:1788483085.562541:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704000 00000100:00100000:2.0:1788483085.562551:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098705024:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562553:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704512 00000100:00100000:0.0:1788483085.562555:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704512 00000100:00100000:2.0:1788483085.562570:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562573:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098705024 00000100:00100000:0.0:1788483085.562575:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098705024 00000100:00100000:2.0:1788483085.562582:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788483085.562588:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098704128:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562588:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788483085.562608:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098704000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562609:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483085.562623:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098704640:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562638:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098704000:12345-0@lo:400:kworker.0 Request processed in 30us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483085.562642:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562644:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788483085.562650:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098705152:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.562654:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704640 00000100:00100000:0.0:1788483085.562657:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704640 00000100:00100000:2.0:1788483085.562668:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483085.562670:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098705152 00000100:00100000:0.0:1788483085.562672:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098705152 00000100:00100000:0.0:1788483085.562683:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788483085.562688:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098704512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562691:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098704000:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562717:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098703744 00000100:00100000:2.0:1788483085.562720:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098703744 00000100:00100000:2.0:1788483085.562759:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788483085.562766:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098703744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483085.562777:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098703872 00002000:00000024:2.0:1788483085.562780:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788483085.562785:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098703872 00000100:00100000:1.0:1788483085.562812:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788483085.562819:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098703872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.562824:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098703744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483085.562830:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788483085.562848:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704384 00000100:00100000:2.0:1788483085.562857:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704384 00000100:00100000:1.0:1788483085.562871:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098703872:12345-0@lo:400:kworker.0 Request processed in 53us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483085.562878:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788483085.562879:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704128 00000100:00100000:2.0:1788483085.562881:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704128 00000100:00100000:2.0:1788483085.562894:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788483085.562899:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4764c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098704384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483085.562914:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704768 00000100:00100000:1.0:1788483085.562918:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704768 00000100:00100000:2.0:1788483085.562931:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4764c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098704384:12345-0@lo:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483085.562937:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788483085.562940:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098705280 00000100:00100000:1.0:1788483085.562942:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098705280 00000100:00100000:1.0:1788483085.562967:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788483085.562973:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098704768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483085.562999:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098704768:12345-0@lo:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483085.563004:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788483085.563014:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788483085.563019:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098705280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483085.563038:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098705280:12345-0@lo:400:kworker.0 Request processed in 20us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483085.563043:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788483085.563057:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788483085.563062:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098704128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.563226:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483085.563248:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098705408:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.563272:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483085.563294:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098703872:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.563313:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098704384:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.563330:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098704896 00000100:00100000:2.0:1788483085.563333:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098704896 00000100:00100000:2.0:1788483085.563350:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098705408 00000100:00100000:2.0:1788483085.563353:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098705408 00000100:00100000:2.0:1788483085.563363:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788483085.563368:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3620:x1875360098704896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.563401:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3620:x1875360098704896:12345-0@lo:400:kworker.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483085.563408:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788483085.563420:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788483085.563425:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098705408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.563450:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098705408:12345-0@lo:400:kworker.0 Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483085.563465:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788483085.563495:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098704896:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.563505:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098705408:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.563546:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098704512:12345-0@lo:400:kworker.0 Request processed in 855us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483085.563561:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788483085.563574:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788483085.563580:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098705024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483085.565009:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098704128:12345-0@lo:400:kworker.0 Request processed in 1938us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483085.565021:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788483085.567087:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788483085.567124:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098704640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483085.567222:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098704640:12345-0@lo:400:kworker.0 Request processed in 110us (4579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483085.567230:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788483085.567253:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788483085.567260:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098705152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483085.567288:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098705152:12345-0@lo:400:kworker.0 Request processed in 29us (4619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483085.567294:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788483085.568629:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098704128:0@lo:400:kworker.0 00010000:00080000:2.0:1788483085.568647:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca4e00 x1875360098704640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483085.568657:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098704640:0@lo:400:kworker.0 00010000:00080000:2.0:1788483085.568667:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3e79c00 x1875360098705152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483085.568673:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098705152:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.568684:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098704512:0@lo:400:kworker.0 00000001:00080000:1.0:1788483085.568933:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1788483085.568945:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:0.0:1788483085.571544:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098705024:12345-0@lo:400:kworker.0 Request processed in 7954us (8962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483085.571561:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:0.0:1788483085.571622:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483085.571629:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483085.571632:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483085.571635:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483085.571686:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483085.571702:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098704256:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.571714:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098704768:0@lo:400:kworker.0 00000100:00100000:0.0:1788483085.571740:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098705280:0@lo:400:kworker.0 00000100:00100000:2.0:1788483085.572972:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098705024:0@lo:400:kworker.0 00000100:00100000:0.0:1788483086.077507:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483086.077529:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098705536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483086.077606:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483086.077663:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098705536 00000100:00100000:0.0:1788483086.077670:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098705536 00000100:00100000:0.0:1788483086.077712:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788483086.077720:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098705536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483086.077761:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788483086.077807:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098705536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483086.077824:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788483086.077872:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098705536:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1788483086.078404:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483086.078408:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483086.078429:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788483086.078435:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788483086.145187:0:14735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483086.145195:0:14735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483086.145219:0:14735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788483086.145226:0:14735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483086.339119:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483086.339148:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087108224 00000100:00100000:1.0:1788483086.339156:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087108224 00000100:00100000:1.0:1788483086.339207:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 202 00000100:00100000:1.0:1788483086.339216:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:12399:x1875360087108224:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:1.0:1788483086.339405:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483086.339425:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b2ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e50f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.339529:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b2b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.339544:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b2b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.339568:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b2b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483086.339581:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788483086.339682:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b2ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e50f expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.339697:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b2b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e50f expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.339705:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483086.339708:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788483086.339712:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27400, rc 0) 00000100:00100000:1.0:1788483086.340877:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:12399:x1875360087108224:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1656us (1775us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788483086.340886:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 202 00000100:00080000:1.0:1788483086.340917:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483086.364811:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483086.364869:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087108352 00000100:00100000:1.0:1788483086.364878:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087108352 00000100:00100000:1.0:1788483086.365011:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 203 00000100:00100000:1.0:1788483086.365022:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:12399:x1875360087108352:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:1.0:1788483086.365134:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365150:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365171:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365215:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365229:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365236:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365303:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365312:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365330:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483086.365372:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365383:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365389:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365395:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365411:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483086.365415:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365423:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365436:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483086.365439:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483086.365443:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365449:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b2c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365460:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365466:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365471:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365476:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483086.365479:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365486:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365506:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69f63d2900) 00010000:00010000:1.0:1788483086.365509:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483086.365512:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365518:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1b2c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365532:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365537:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365543:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365547:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483086.365550:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365556:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365564:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:1.0:1788483086.365566:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483086.365569:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.365575:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26400/0x1d7ea3d89ea1b2ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483086.365655:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:12399:x1875360087108352:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 633us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483086.365664:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 203 00000100:00100000:2.0:1788483086.433775:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483086.442078:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087108608 00000100:00100000:0.0:1788483086.442111:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087108608 00000100:00100000:0.0:1788483086.442174:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 204 00000100:00100000:0.0:1788483086.442183:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:12402:x1875360087108608:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483086.442203:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483086.442223:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b2d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e516 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442309:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442324:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442335:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442349:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442356:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442362:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442466:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442481:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442488:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483086.442497:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788483086.442572:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442579:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442587:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442592:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483086.442597:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442604:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442616:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:0.0:1788483086.442618:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483086.442622:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442629:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b2dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442640:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442652:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442657:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442662:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483086.442666:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442672:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442679:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a68c3183800) 00010000:00010000:0.0:1788483086.442681:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483086.442683:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442689:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b2e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442735:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b2d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442749:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.442756:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:0.0:1788483086.442758:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483086.442766:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8000, rc 0) 00000100:00100000:0.0:1788483086.442829:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12402:x1875360087108608:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 646us (9064us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788483086.442836:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 204 00000100:00100000:0.0:1788483086.447868:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483086.448715:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087108736 00000100:00100000:0.0:1788483086.448735:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087108736 00000100:00100000:0.0:1788483086.448788:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 205 00000100:00100000:0.0:1788483086.448798:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12402:x1875360087108736:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:0.0:1788483086.448876:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.448905:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.448917:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.448950:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.448957:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.448964:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.448970:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483086.448975:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.448994:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.449006:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:0.0:1788483086.449008:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483086.449013:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.449019:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483086.449092:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12402:x1875360087108736:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 295us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483086.449117:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 205 00000100:00100000:0.0:1788483086.473244:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483086.473275:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087108992 00000100:00100000:0.0:1788483086.473284:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087108992 00000100:00100000:0.0:1788483086.473335:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:0.0:1788483086.473345:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12402:x1875360087108992:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:0.0:1788483086.473546:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:12402:x1875360087108992:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 202us (310us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788483086.473554:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00010000:00010000:2.0:1788483086.481383:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483086.537208:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483086.537445:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087109248 00000100:00100000:0.0:1788483086.537454:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087109248 00000100:00100000:0.0:1788483086.537517:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 206 00000100:00100000:0.0:1788483086.537529:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:11923:x1875360087109248:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483086.537553:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483086.537586:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e51d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.537682:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.537695:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.537704:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.537744:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.537758:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 29 pid: 6494 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483086.537770:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875360098705664:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483086.537984:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26216c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483086.555637:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483086.556499:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087109376 00000100:00100000:3.0:1788483086.556508:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087109376 00010000:00010000:3.0:1788483086.556550:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 30 pid: 6494 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483086.556597:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 94 00000100:00100000:3.0:1788483086.556607:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:2392:x1875360087109376:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483086.556621:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483086.556627:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 30 pid: 6494 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.556640:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 30 pid: 6494 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.556660:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:3.0:1788483086.556665:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.556674:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.556681:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.556710:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483086.556780:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:2392:x1875360087109376:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 174us (1151us total) trans 0 rc 0/0 00010000:00010000:2.0:1788483086.556783:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b2ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e516 expref: 30 pid: 6494 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483086.556787:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 94 00000100:00100000:2.0:1788483086.556798:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875360098705664:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483086.556831:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.556849:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.556855:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483086.556872:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788483086.556993:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b2ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.557007:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 29 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.557015:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:2.0:1788483086.557017:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483086.557019:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8c00, rc 0) 00000100:00100000:2.0:1788483086.557050:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:11923:x1875360087109248:12345-192.168.206.54@tcp:101:bash.0 Request processed in 19524us (19850us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788483086.557056:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 206 00000100:00100000:2.0:1788483086.570263:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483086.570480:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087109504 00000100:00100000:0.0:1788483086.570491:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087109504 00000100:00100000:0.0:1788483086.570554:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 207 00000100:00100000:0.0:1788483086.570564:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:11923:x1875360087109504:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483086.570588:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483086.570607:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b314 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e524 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.570661:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b31b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.570675:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.570686:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.570815:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b314 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e524 expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.570835:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b31b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e524 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.570854:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:0.0:1788483086.570858:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483086.570861:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:0.0:1788483086.570925:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:11923:x1875360087109504:12345-192.168.206.54@tcp:101:bash.0 Request processed in 362us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483086.570932:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 207 00000100:00100000:3.0:1788483086.574697:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483086.582022:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087109760 00000100:00100000:0.0:1788483086.582036:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087109760 00000100:00100000:0.0:1788483086.582116:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 208 00000100:00100000:0.0:1788483086.582128:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:11923:x1875360087109760:12345-192.168.206.54@tcp:36:bash.0 00010000:00010000:0.0:1788483086.582356:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.582389:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.582400:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483086.582443:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788483086.582467:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e37562a reply state 0000000060d4a7e7 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.582480:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483086.582487:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:0.0:1788483086.582490:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788483086.582494:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788483086.582533:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788483086.582639:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:11923:x1875360087109760:12345-192.168.206.54@tcp:36:bash.0 Request processed in 512us (7954us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788483086.582646:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 208 00000020:00080000:0.0:1788483086.582652:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788483086.586219:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483086.586547:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087109888 00000100:00100000:2.0:1788483086.586556:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087109888 00000100:00100000:2.0:1788483086.586605:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 209 00000100:00100000:2.0:1788483086.586614:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+34:11923:x1875360087109888:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483086.586635:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483086.586664:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e52b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.586732:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e52b expref: 35 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.586745:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e52b expref: 35 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.586761:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:2.0:1788483086.586764:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483086.586767:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6400, rc 0) 00000100:00100000:2.0:1788483086.586821:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:11923:x1875360087109888:12345-192.168.206.54@tcp:101:bash.0 Request processed in 208us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483086.586827:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 209 00000100:00100000:1.0:1788483086.592627:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483086.592732:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087110016 00000100:00100000:2.0:1788483086.592742:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087110016 00000100:00100000:2.0:1788483086.592815:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:2.0:1788483086.592824:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:11923:x1875360087110016:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483086.592850:0:8551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483086.592872:0:8551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e532 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483086.592895:0:8551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a1609, atime: 0x6a9a1607, ctime: 0x6a9a1609, blocks: 0x8 00010000:00010000:2.0:1788483086.592915:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1788483086.592919:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483086.592928:0:8551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 8 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.592969:0:8551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 8 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.592982:0:8551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6200, rc 0) 00000100:00100000:2.0:1788483086.593041:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:11923:x1875360087110016:12345-192.168.206.54@tcp:101:bash.0 Request processed in 218us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483086.593048:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00080000:1.0:1788483086.593453:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483086.598847:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483086.598960:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087110144 00000100:00100000:1.0:1788483086.598970:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087110144 00002000:00010000:1.0:1788483086.599010:0:8417:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788483086.599015:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c3f67480 with x1875360087110144 ext(0->18446744073709551615) 00002000:00010000:1.0:1788483086.599027:0:8417:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68c3f67480. 00000100:00100000:1.0:1788483086.599064:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:1.0:1788483086.599074:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2391:x1875360087110144:12345-192.168.206.54@tcp:10:bash.0 00002000:00010000:1.0:1788483086.599388:0:8417:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788483086.599392:0:8417:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788483081 -> 1788483085 00002000:00010000:1.0:1788483086.599395:0:8417:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788483079 -> 1788483079 00002000:00010000:1.0:1788483086.599397:0:8417:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788483081 -> 1788483085 00002000:00010000:1.0:1788483086.599399:0:8417:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788483086.599470:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2391:x1875360087110144:12345-192.168.206.54@tcp:10:bash.0 Request processed in 395us (631us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788483086.599478:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00002000:00010000:1.0:1788483086.599482:0:8417:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788483086.599484:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c3f67480 with x1875360087110144 ext(0->18446744073709551615) 00002000:00010000:1.0:1788483086.599489:0:8417:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68c3f67480. 00000100:00100000:0.0:1788483086.735476:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483086.735799:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087110272 00000100:00100000:3.0:1788483086.735809:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087110272 00000100:00100000:3.0:1788483086.736023:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 210 00000100:00100000:3.0:1788483086.736035:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12416:x1875360087110272:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:3.0:1788483086.736151:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736168:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736180:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736196:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736203:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736209:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736282:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736291:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736297:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483086.736369:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736380:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736385:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736391:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736397:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483086.736400:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736406:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736419:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483086.736421:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483086.736425:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736431:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b337 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736444:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736449:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736460:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736465:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483086.736468:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736473:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736479:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a68c1c53f00) 00010000:00010000:3.0:1788483086.736481:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483086.736483:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736488:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b33e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736500:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736505:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736510:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736514:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483086.736516:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736529:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736536:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:3.0:1788483086.736538:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483086.736540:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.736545:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b345 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483086.736617:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12416:x1875360087110272:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 583us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483086.736624:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 210 00000100:00100000:3.0:1788483086.775495:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483086.775682:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087110528 00000100:00100000:2.0:1788483086.775702:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087110528 00000100:00100000:2.0:1788483086.775778:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 211 00000100:00100000:2.0:1788483086.775788:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+35:12419:x1875360087110528:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483086.775808:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483086.775830:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b34c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e539 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.775910:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.775924:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.775936:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.775951:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.775976:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.775983:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776088:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776134:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776142:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483086.776151:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788483086.776230:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776237:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776243:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776248:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483086.776252:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776259:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776281:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483086.776284:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483086.776288:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776295:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b353 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776307:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776314:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776320:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776326:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483086.776328:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776334:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776342:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:2.0:1788483086.776345:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483086.776347:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776354:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b35a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776400:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b34c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e539 expref: 38 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776415:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e539 expref: 37 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.776421:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:2.0:1788483086.776423:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788483086.776426:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76e00, rc 0) 00000100:00100000:2.0:1788483086.776489:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12419:x1875360087110528:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 703us (1001us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788483086.776496:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 211 00000100:00100000:2.0:1788483086.779771:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483086.779986:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087110656 00000100:00100000:1.0:1788483086.780009:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087110656 00000100:00100000:1.0:1788483086.780066:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 212 00000100:00100000:1.0:1788483086.780076:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12419:x1875360087110656:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:1.0:1788483086.780168:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.780183:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 37 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.780192:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.780221:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 37 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.780233:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 37 pid: 6494 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483086.780246:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098705792:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483086.780316:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483086.785127:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483086.785234:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875360098705792:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483086.785262:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483086.785338:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087110912 00000100:00100000:0.0:1788483086.785345:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087110912 00000100:00100000:0.0:1788483086.785400:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:0.0:1788483086.785410:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:6164:x1875360087110912:12345-192.168.206.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788483086.785683:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:6164:x1875360087110912:12345-192.168.206.54@tcp:35:ldlm_bl.0 Request processed in 273us (594us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788483086.785691:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:0.0:1788483086.790624:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483086.790748:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087111040 00000100:00100000:3.0:1788483086.790758:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087111040 00010000:00010000:3.0:1788483086.790802:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 39 pid: 6494 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483086.790849:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 95 00000100:00100000:3.0:1788483086.790860:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:2393:x1875360087111040:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483086.790874:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483086.790896:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 39 pid: 6494 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.790910:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 39 pid: 6494 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.790934:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b306 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e51d expref: 39 pid: 6494 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.790950:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:3.0:1788483086.790956:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.790966:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.790973:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.791007:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483086.791064:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:2393:x1875360087111040:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 204us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483086.791072:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 95 00010000:00010000:1.0:1788483086.792004:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792015:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792056:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792076:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792082:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792088:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483086.792091:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792136:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792149:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:1.0:1788483086.792152:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788483086.792156:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.792162:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b36f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483086.792228:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12419:x1875360087110656:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 12151us (12461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483086.792236:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 212 00000100:00100000:0.0:1788483086.799409:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483086.799512:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087111296 00000100:00100000:2.0:1788483086.799522:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087111296 00000100:00100000:2.0:1788483086.799580:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:2.0:1788483086.799590:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+37:12419:x1875360087111296:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483086.799827:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:12419:x1875360087111296:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 238us (428us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788483086.799836:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00000040:00080000:1.0:1788483086.840912:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788483086.915659:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483086.915777:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087111552 00000100:00100000:1.0:1788483086.915789:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087111552 00000100:00100000:1.0:1788483086.915856:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 213 00000100:00100000:1.0:1788483086.915867:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+38:12430:x1875360087111552:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:1.0:1788483086.915906:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483086.915927:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b376 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e540 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.915998:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916013:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916023:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916038:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916045:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916051:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916182:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b38b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916191:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916210:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483086.916220:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788483086.916302:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916309:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916316:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916323:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483086.916327:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916334:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916347:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483086.916350:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483086.916354:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916360:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b37d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916372:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916378:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916383:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916387:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483086.916398:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916403:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916411:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69f63d2500) 00010000:00010000:1.0:1788483086.916413:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483086.916416:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916421:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916457:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b376 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e540 expref: 41 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916471:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e540 expref: 40 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483086.916477:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:1.0:1788483086.916479:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483086.916482:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27600, rc 0) 00000100:00100000:1.0:1788483086.916546:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12430:x1875360087111552:12345-192.168.206.54@tcp:101:cat.0 Request processed in 681us (895us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788483086.916553:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 213 00000100:00100000:1.0:1788483086.924496:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483086.924729:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087111808 00000100:00100000:2.0:1788483086.924739:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087111808 00000100:00100000:2.0:1788483086.924791:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:2.0:1788483086.924800:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+40:12430:x1875360087111808:12345-192.168.206.54@tcp:35:cat.0 00000100:00100000:2.0:1788483086.925161:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12430:x1875360087111808:12345-192.168.206.54@tcp:35:cat.0 Request processed in 360us (672us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788483086.925168:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:3.0:1788483086.956568:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483086.957122:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087112064 00000100:00100000:2.0:1788483086.957133:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087112064 00000100:00100000:2.0:1788483086.957204:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 214 00000100:00100000:2.0:1788483086.957214:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+41:12431:x1875360087112064:12345-192.168.206.54@tcp:36:rm.0 00010000:00010000:2.0:1788483086.957477:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788483086.957506:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e52b expref: 41 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957528:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b38b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e540 expref: 40 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957540:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e539 expref: 39 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957551:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b31b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e524 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957560:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:2.0:1788483086.957565:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483086.957587:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957602:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957630:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957646:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957654:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957661:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957830:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957964:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.957973:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483086.958465:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788483086.958476:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379221378878ns, next at 380221375933ns, rc = 0 00010000:00010000:2.0:1788483086.958534:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958545:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958553:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958572:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958579:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958584:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958605:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483086.958624:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958630:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958637:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958643:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483086.958647:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958653:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958663:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:2.0:1788483086.958666:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788483086.958670:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.958686:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b3a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959000:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959006:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959013:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959018:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483086.959021:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959027:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959037:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483086.959039:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483086.959042:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959048:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b399 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483086.959058:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c39b1d4 reply state 000000004aebb16d transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959068:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483086.959081:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:2.0:1788483086.959083:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483086.959086:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788483086.959173:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483086.959180:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.959187:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483086.959191:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.959214:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.959231:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:3.0:1788483086.959234:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788483086.959237:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.959243:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1b3ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483086.959253:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483086.959255:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483086.959257:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483086.959547:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:12431:x1875360087112064:12345-192.168.206.54@tcp:36:rm.0 Request processed in 2332us (2986us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788483086.959557:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 214 00000100:00100000:0.0:1788483087.026063:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483087.026365:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087112320 00000100:00100000:1.0:1788483087.026379:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087112320 00000100:00100000:1.0:1788483087.026446:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 215 00000100:00100000:1.0:1788483087.026475:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+39:12437:x1875360087112320:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:1.0:1788483087.026503:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483087.026539:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b3b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e547 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483087.026656:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483087.026672:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483087.026684:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483087.026708:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483087.026725:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483087.026734:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483087.027046:0:8434:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788483087.033604:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033629:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033641:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033770:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033779:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033786:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033793:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.033797:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033806:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033909:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483087.033913:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483087.033918:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033924:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b3bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483087.033941:0:8434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c4f73a5 reply state 00000000ef7c04e0 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033953:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.033959:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:2.0:1788483087.033962:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483087.033965:0:8434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788483087.034009:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1b3b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 42 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.034024:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 41 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.034031:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:2.0:1788483087.034033:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483087.034035:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6400, rc 0) 00000100:00100000:2.0:1788483087.034214:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:12437:x1875360087112320:12345-192.168.206.54@tcp:101:bash.0 Request processed in 7742us (8160us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788483087.034230:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 215 00000100:00100000:1.0:1788483087.051458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.051825:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087112448 00000100:00100000:3.0:1788483087.051836:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087112448 00000100:00100000:3.0:1788483087.051914:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:3.0:1788483087.051924:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2390:x1875360087112448:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:3.0:1788483087.051940:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483087.051960:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e54e expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483087.051985:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483087.052003:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1788483087.052008:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483087.052017:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.052055:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.052069:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2e00, rc 0) 00000100:00100000:3.0:1788483087.052167:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2390:x1875360087112448:12345-192.168.206.54@tcp:101:bash.0 Request processed in 244us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.052174:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00080000:1.0:1788483087.052469:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483087.060626:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.060862:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087112576 00000100:00100000:2.0:1788483087.060872:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087112576 00000100:00100000:2.0:1788483087.060928:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:2.0:1788483087.060938:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:12437:x1875360087112576:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483087.060955:0:8551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483087.060972:0:8551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e555 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.061002:0:8551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.061011:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483087.061015:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483087.061020:0:8551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 7 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.061055:0:8551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.061069:0:8551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 7 pid: 8411 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483087.061083:0:8551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8551:1875360098705920:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483087.061193:0:8551:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483087.068438:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483087.068557:0:8551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8551:1875360098705920:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483087.068592:0:8551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 7 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.068612:0:8551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6a00, rc 0) 00000100:00100000:0.0:1788483087.068672:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:12437:x1875360087112576:12345-192.168.206.54@tcp:101:bash.0 Request processed in 7735us (8055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483087.068680:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:3.0:1788483087.069497:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087112704 00000100:00100000:3.0:1788483087.069506:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087112704 00010000:00010000:3.0:1788483087.069549:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 7 pid: 8411 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483087.069583:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 96 00000100:00100000:3.0:1788483087.069592:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087112704:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483087.069605:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483087.069624:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 7 pid: 8411 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.069638:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 7 pid: 8411 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.069658:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b3d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e54e expref: 7 pid: 8411 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.069858:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483087.069864:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483087.069873:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 6 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.069883:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 6 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.069916:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 6 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483087.069929:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6479:1875360098706048:192.168.206.54@tcp:105: 00000100:00100000:3.0:1788483087.070026:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788483087.083558:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483087.083712:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087112960 00000100:00100000:0.0:1788483087.083731:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087112960 00000100:00100000:0.0:1788483087.083792:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:0.0:1788483087.083802:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+42:12437:x1875360087112960:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:0.0:1788483087.084077:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:12437:x1875360087112960:12345-192.168.206.54@tcp:35:bash.0 Request processed in 276us (528us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788483087.084085:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:3.0:1788483087.084369:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6479:1875360098706048:192.168.206.54@tcp:105: 00010000:00010000:3.0:1788483087.084390:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483087.084414:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2392:x1875360087112704:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 14823us (15985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.084422:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 96 00000100:00100000:2.0:1788483087.096583:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098706176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483087.096698:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483087.096775:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098706176 00000100:00100000:2.0:1788483087.096783:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098706176 00000100:00100000:2.0:1788483087.096826:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788483087.096835:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098706176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483087.096865:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788483087.096910:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098706176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.096917:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788483087.096962:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098706176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483087.099252:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098706304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483087.099309:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483087.099631:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098706304 00000100:00100000:3.0:1788483087.099639:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098706304 00000100:00100000:3.0:1788483087.099702:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788483087.099711:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098706304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483087.099758:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483087.099804:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098706304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.099825:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788483087.099869:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098706304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483087.100242:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483087.100251:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098706432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483087.100280:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483087.100306:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098706432 00000100:00100000:0.0:1788483087.100310:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098706432 00000100:00100000:0.0:1788483087.100335:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788483087.100341:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098706432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483087.100351:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483087.100400:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098706432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483087.100407:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788483087.100432:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1788483087.100438:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1788483087.100452:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a68c447ca80, transno 4294967308 00000100:00100000:0.0:1788483087.100464:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098706432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788483087.100926:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483087.329294:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.329428:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087113088 00000100:00100000:3.0:1788483087.329438:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087113088 00000100:00100000:3.0:1788483087.329501:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 216 00000100:00100000:3.0:1788483087.329511:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+43:12453:x1875360087113088:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483087.329537:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483087.329605:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b3e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e55c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.329670:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b3ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.329687:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.329699:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483087.329759:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788483087.329763:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483087.329783:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.329807:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b3e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e55c expref: 45 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.329827:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e55c expref: 44 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.329854:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483087.329858:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483087.329862:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3400, rc 0) 00000100:00100000:3.0:1788483087.330862:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:12453:x1875360087113088:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1346us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.330872:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 216 00000100:00100000:2.0:1788483087.342534:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483087.342714:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087113344 00000100:00100000:0.0:1788483087.342732:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087113344 00000100:00100000:0.0:1788483087.342786:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 217 00000100:00100000:0.0:1788483087.342796:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+44:12453:x1875360087113344:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483087.342817:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483087.342838:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b3f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e563 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.342957:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b3fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.342970:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.342980:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483087.342991:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788483087.343090:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b3f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e563 expref: 47 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.343142:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b3fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e563 expref: 46 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.343165:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:0.0:1788483087.343168:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483087.343171:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:0.0:1788483087.343428:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+46:12453:x1875360087113344:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 631us (901us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788483087.343435:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 217 00000100:00100000:0.0:1788483087.348128:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.348363:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087113472 00000100:00100000:3.0:1788483087.348373:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087113472 00000100:00100000:3.0:1788483087.348444:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:3.0:1788483087.348455:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+46:2393:x1875360087113472:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483087.348468:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483087.348494:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b3fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e563 expref: 46 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.348513:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:3.0:1788483087.348517:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483087.348574:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+45:2393:x1875360087113472:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 120us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.348582:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:1.0:1788483087.352231:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.352410:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087113728 00000100:00100000:2.0:1788483087.352420:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087113728 00000100:00100000:2.0:1788483087.352471:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 218 00000100:00100000:2.0:1788483087.352482:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+45:12453:x1875360087113728:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483087.352504:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483087.352525:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b409 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e56a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.352632:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b410 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.352647:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b410 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.352672:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b410 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483087.352696:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788483087.352806:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b409 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e56a expref: 48 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.352825:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b410 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e56a expref: 47 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.352833:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:2.0:1788483087.352836:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788483087.352840:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76000, rc 0) 00000100:00100000:2.0:1788483087.352899:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+47:12453:x1875360087113728:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 418us (683us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788483087.352905:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 218 00000100:00100000:2.0:1788483087.374405:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.374562:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087113856 00000100:00100000:3.0:1788483087.374573:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087113856 00000100:00100000:3.0:1788483087.374639:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:3.0:1788483087.374650:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+6:2391:x1875360087113856:12345-192.168.206.54@tcp:1:lfs.0 00010000:00010000:3.0:1788483087.374704:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.374758:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 6 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.374767:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483087.374772:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483087.374777:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.374812:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 6 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.374827:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 6 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483087.374842:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1875360098706560:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483087.374942:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788483087.381062:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.381230:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1875360098706560:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483087.381257:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483087.381463:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087113984 00000100:00100000:2.0:1788483087.381470:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087113984 00002000:00100000:2.0:1788483087.381515:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a68c452c700 x1875360087113984/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:593/0 lens 504/0 e 0 to 0 dl 1788483098 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483087.381525:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c452c700 with x1875360087113984 ext(0->8) 00010000:00010000:2.0:1788483087.381533:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 7 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.381546:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 7 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483087.381569:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a68c452c700 00000100:00100000:2.0:1788483087.381603:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:2.0:1788483087.381612:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2393:x1875360087113984:12345-192.168.206.54@tcp:4:lfs.0 00000100:00100000:2.0:1788483087.385634:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2393:x1875360087113984:12345-192.168.206.54@tcp:4:lfs.0 Request processed in 4011us (4570us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788483087.385647:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00002000:00100000:2.0:1788483087.385659:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a68c452c700 x1875360087113984/t4294967309(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:593/0 lens 504/448 e 0 to 0 dl 1788483098 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483087.385670:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68c452c700 with x1875360087113984 ext(0->8) 00010000:00010000:2.0:1788483087.385680:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 9 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.385699:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 9 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483087.385706:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a68c452c700 00000100:00100000:1.0:1788483087.391649:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483087.391862:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087114112 00000100:00100000:0.0:1788483087.391875:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087114112 00010000:00010000:0.0:1788483087.391923:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 9 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483087.391971:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 97 00000100:00100000:0.0:1788483087.391981:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2391:x1875360087114112:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483087.391997:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788483087.392019:0:7436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788483087.392022:0:7436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788483086 00002000:00010000:0.0:1788483087.392025:0:7436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788483086 00002000:00010000:0.0:1788483087.392027:0:7436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788483086 00002000:00010000:0.0:1788483087.392029:0:7436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788483087.392036:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 9 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.392051:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 9 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.392087:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1b3df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e555 expref: 9 pid: 8551 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.392148:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483087.392154:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483087.392160:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.392171:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.392487:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483087.392539:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2391:x1875360087114112:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 558us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483087.392546:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 97 00010000:00010000:2.0:1788483087.392619:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392630:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392649:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392665:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392672:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392679:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483087.392683:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392704:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392734:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.392742:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db56164c/0x1d7ea3d89ea1b41e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483087.392788:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087113856:12345-192.168.206.54@tcp:1:lfs.0 Request processed in 18141us (18393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.392796:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:1.0:1788483087.395924:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483087.396047:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087114368 00000100:00100000:0.0:1788483087.396056:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087114368 00000100:00100000:0.0:1788483087.396139:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:0.0:1788483087.396149:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4620050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+47:12453:x1875360087114368:12345-192.168.206.54@tcp:35:lfs.0 00000004:00010000:0.0:1788483087.396323:0:6496:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b410 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e56a expref: 47 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483087.396503:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788483087.396538:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788483087.396810:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788483087.397456:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.397486:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 51 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.397494:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.397533:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 51 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.397549:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 51 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483087.397565:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875360098706688:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483087.397706:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788483087.421964:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875360098706688:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483087.421994:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483087.422767:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.427358:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087114496 00000100:00100000:3.0:1788483087.427373:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087114496 00010000:00010000:3.0:1788483087.427422:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 52 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483087.431764:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 98 00000100:00100000:3.0:1788483087.431790:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+52:2392:x1875360087114496:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483087.431812:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483087.431824:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 52 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.431851:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 52 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.431875:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1b3ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e547 expref: 52 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.431892:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:3.0:1788483087.431897:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.431906:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.431913:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.431950:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483087.432004:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+51:2392:x1875360087114496:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 227us (9240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.432012:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 98 00010000:00010000:2.0:1788483087.432631:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.432658:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483087.432785:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788483087.432919:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788483087.433011:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098706816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788483087.433068:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483087.433130:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483087.433337:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098706816 00000100:00100000:1.0:1788483087.433344:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098706816 00000100:00100000:1.0:1788483087.433389:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788483087.433397:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098706816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788483087.433476:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098706816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483087.433483:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788483087.434711:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098706816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788483087.434878:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788483087.434951:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098706944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788483087.434997:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483087.435019:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483087.435624:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098706944 00000100:00100000:1.0:1788483087.435632:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098706944 00000100:00100000:1.0:1788483087.435673:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788483087.435682:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6496:x1875360098706944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788483087.435977:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875360098706944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788483087.436025:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788483087.436058:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.436068:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.436076:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.436083:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.436087:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.436129:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.436145:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:2.0:1788483087.436147:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788483087.436152:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.436157:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b425 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788483087.436277:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788483087.436337:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788483087.436348:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379699250942ns, next at 380699248877ns, rc = 0 00000001:00080000:2.0:1788483087.436354:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788483087.436379:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69f63d2500) 00010000:00010000:2.0:1788483087.436382:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788483087.436388:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b410 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e56a expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483087.436479:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4620050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:12453:x1875360087114368:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 40331us (40564us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788483087.436487:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 56 00000020:00080000:2.0:1788483087.436491:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788483087.439565:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6496:x1875360098706944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 154us (838us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788483087.439585:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788483087.444767:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.444845:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087114624 00000100:00100000:2.0:1788483087.444855:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087114624 00000100:00100000:2.0:1788483087.444909:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 219 00000100:00100000:2.0:1788483087.444919:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+54:12453:x1875360087114624:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483087.444956:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483087.444980:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b42c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e571 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.445035:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b42c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e571 expref: 55 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.445049:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b42c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e571 expref: 55 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.445065:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483087.445068:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483087.445072:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77c00, rc 0) 00000100:00100000:2.0:1788483087.445154:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+55:12453:x1875360087114624:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 236us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.445162:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 219 00000100:00100000:2.0:1788483087.450568:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483087.450685:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087114880 00000100:00100000:1.0:1788483087.450705:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087114880 00000100:00100000:1.0:1788483087.450775:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:1.0:1788483087.450788:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+55:12453:x1875360087114880:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:1.0:1788483087.451046:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:12453:x1875360087114880:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 260us (485us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788483087.451054:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 57 00010000:00010000:3.0:1788483087.481497:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483087.614619:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.614740:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087115008 00000100:00100000:2.0:1788483087.614750:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087115008 00000100:00100000:2.0:1788483087.614808:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 220 00000100:00100000:2.0:1788483087.614818:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:12463:x1875360087115008:12345-192.168.206.54@tcp:34:lfs.0 00010000:00010000:2.0:1788483087.614902:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.614918:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.614929:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.614955:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.614963:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.614970:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615045:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615054:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615061:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483087.615153:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615165:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615171:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615177:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615183:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.615186:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615212:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615225:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483087.615228:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483087.615232:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615237:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76000/0x1d7ea3d89ea1b433 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615250:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615256:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615262:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615267:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.615270:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615277:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615284:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:2.0:1788483087.615287:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483087.615289:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615305:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b43a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615315:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615321:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615327:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615332:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.615334:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615340:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615348:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483087.615350:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483087.615353:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.615358:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b441 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483087.615434:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:12463:x1875360087115008:12345-192.168.206.54@tcp:34:lfs.0 Request processed in 616us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.615442:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 220 00000100:00100000:0.0:1788483087.709426:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.709521:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087115264 00000100:00100000:2.0:1788483087.709530:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087115264 00000100:00100000:2.0:1788483087.709588:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 221 00000100:00100000:2.0:1788483087.709598:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+56:12466:x1875360087115264:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483087.709616:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483087.709636:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b448 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e578 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709723:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709745:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709755:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709770:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709777:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709783:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709896:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b45d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709905:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.709928:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483087.709938:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788483087.710012:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710020:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710027:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710034:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.710039:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710046:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710058:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483087.710061:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483087.710065:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710071:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b44f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710083:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710089:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710149:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710155:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.710158:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710165:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710174:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:2.0:1788483087.710176:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483087.710179:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710184:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710217:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b448 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e578 expref: 59 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710230:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b45d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e578 expref: 58 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.710237:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483087.710240:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483087.710242:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1a00, rc 0) 00000100:00100000:2.0:1788483087.710300:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:12466:x1875360087115264:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 703us (882us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788483087.710317:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 221 00000100:00100000:1.0:1788483087.716274:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.716345:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087115392 00000100:00100000:2.0:1788483087.716353:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087115392 00000100:00100000:2.0:1788483087.716409:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 222 00000100:00100000:2.0:1788483087.716419:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69df0ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:12466:x1875360087115392:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:2.0:1788483087.716484:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716500:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716511:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716545:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716551:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716558:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716564:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483087.716569:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716576:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716587:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483087.716602:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483087.716607:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.716614:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b46b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483087.716698:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69df0ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:12466:x1875360087115392:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 279us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.716705:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 222 00000100:00100000:1.0:1788483087.725753:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.725922:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087115648 00000100:00100000:3.0:1788483087.725932:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087115648 00000100:00100000:3.0:1788483087.725984:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:3.0:1788483087.725995:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+58:12466:x1875360087115648:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483087.726252:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+59:12466:x1875360087115648:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 257us (505us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788483087.726260:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:0.0:1788483087.834323:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.834433:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087115904 00000100:00100000:2.0:1788483087.834443:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087115904 00000100:00100000:2.0:1788483087.834505:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 223 00000100:00100000:2.0:1788483087.834515:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+59:12476:x1875360087115904:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483087.834537:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483087.834540:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788483087.834567:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b3ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e55c expref: 59 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.834595:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483087.834600:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483087.834612:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b472 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e57f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.834878:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.834956:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.834983:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483087.834996:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788483087.835191:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b472 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e57f expref: 61 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.835208:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e57f expref: 60 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.835215:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483087.835217:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483087.835220:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1e00, rc 0) 00000100:00100000:2.0:1788483087.835332:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:12476:x1875360087115904:12345-192.168.206.54@tcp:101:bash.0 Request processed in 818us (1016us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788483087.835340:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 223 00000100:00100000:1.0:1788483087.845089:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.845224:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087116032 00000100:00100000:3.0:1788483087.845233:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087116032 00000100:00100000:3.0:1788483087.845318:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 224 00000100:00100000:3.0:1788483087.845329:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:12476:x1875360087116032:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:3.0:1788483087.845352:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483087.845372:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b487 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e586 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.845405:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.845430:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.845441:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.845560:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b487 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.845588:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.845609:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:3.0:1788483087.845612:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483087.845616:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3600, rc 0) 00000100:00100000:3.0:1788483087.845730:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:12476:x1875360087116032:12345-192.168.206.54@tcp:101:bash.0 Request processed in 402us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.845738:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 224 00000100:00100000:1.0:1788483087.859633:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483087.859700:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.860359:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087116160 00000100:00100000:3.0:1788483087.860369:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087116160 00000100:00100000:3.0:1788483087.860439:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:3.0:1788483087.860449:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+61:2393:x1875360087116160:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483087.860464:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483087.860489:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e57f expref: 61 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.860508:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:3.0:1788483087.860512:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483087.860562:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:2393:x1875360087116160:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 114us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.860570:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:0.0:1788483087.861625:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087116416 00000100:00100000:0.0:1788483087.861633:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087116416 00000100:00100000:0.0:1788483087.861679:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 225 00000100:00100000:0.0:1788483087.861698:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+60:12476:x1875360087116416:12345-192.168.206.54@tcp:36:bash.0 00010000:00010000:0.0:1788483087.861758:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483087.861786:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b45d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e578 expref: 60 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.861810:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:0.0:1788483087.861814:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483087.862349:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.862364:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.862373:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483087.862418:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788483087.862442:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f088a6b reply state 0000000027b674b1 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.862455:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.862462:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:0.0:1788483087.862465:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788483087.862468:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788483087.862564:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:12476:x1875360087116416:12345-192.168.206.54@tcp:36:bash.0 Request processed in 876us (2863us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788483087.862571:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 225 00000020:00080000:0.0:1788483087.862575:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788483087.867462:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.867740:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087116544 00000100:00100000:2.0:1788483087.867750:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087116544 00000100:00100000:2.0:1788483087.867811:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 226 00000100:00100000:2.0:1788483087.867821:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+62:12476:x1875360087116544:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483087.867852:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483087.867872:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b49c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e58d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.868365:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.868394:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.868404:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483087.868435:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788483087.868439:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483087.868457:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.868486:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b49c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 64 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.868502:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.868509:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483087.868512:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483087.868514:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1c00, rc 0) 00000100:00100000:2.0:1788483087.868573:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+63:12476:x1875360087116544:12345-192.168.206.54@tcp:101:bash.0 Request processed in 753us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.868580:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 226 00000100:00100000:2.0:1788483087.873371:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.873483:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087116800 00000100:00100000:3.0:1788483087.873492:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087116800 00000100:00100000:3.0:1788483087.873541:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:3.0:1788483087.873550:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+63:12476:x1875360087116800:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:3.0:1788483087.873787:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+64:12476:x1875360087116800:12345-192.168.206.54@tcp:35:bash.0 Request processed in 237us (422us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788483087.873810:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:3.0:1788483087.970291:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.970398:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087116928 00000100:00100000:2.0:1788483087.970408:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087116928 00000100:00100000:2.0:1788483087.970468:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 227 00000100:00100000:2.0:1788483087.970478:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+64:12482:x1875360087116928:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483087.970525:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483087.970545:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b4aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e594 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.971033:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b4b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.971047:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.971056:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483087.971126:0:8434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788483087.971130:0:8434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483087.971147:0:8434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.971173:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b4aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e594 expref: 66 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.971191:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e594 expref: 65 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.971199:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483087.971202:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483087.971205:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1e00, rc 0) 00000100:00100000:2.0:1788483087.971272:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:12482:x1875360087116928:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 794us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.971280:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 227 00000100:00100000:1.0:1788483087.980334:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483087.980432:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087117056 00000100:00100000:3.0:1788483087.980441:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087117056 00000100:00100000:3.0:1788483087.980641:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 228 00000100:00100000:3.0:1788483087.980651:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:12482:x1875360087117056:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483087.980668:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483087.980695:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b4b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e59b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980764:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980778:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980788:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980798:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980806:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980812:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980889:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980911:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.980918:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483087.981194:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788483087.981199:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483087.981217:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981228:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981236:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981243:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981250:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981255:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483087.981259:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981266:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981276:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483087.981279:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483087.981288:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981295:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b4bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981308:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981315:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981321:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981325:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483087.981328:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981334:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981340:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:3.0:1788483087.981342:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483087.981344:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981349:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b4c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981370:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b4b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e59b expref: 67 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981391:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b4cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e59b expref: 66 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483087.981398:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:3.0:1788483087.981401:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483087.981403:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3400, rc 0) 00000100:00100000:3.0:1788483087.981505:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:12482:x1875360087117056:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 856us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483087.981572:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 228 00000100:00100000:0.0:1788483087.988810:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483087.989171:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087117184 00000100:00100000:2.0:1788483087.989181:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087117184 00000100:00100000:2.0:1788483087.989246:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:2.0:1788483087.989256:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:2391:x1875360087117184:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483087.989271:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483087.989294:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3400/0x1d7ea3d89ea1b4cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e59b expref: 66 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483087.989315:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483087.989319:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483087.989373:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:2391:x1875360087117184:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 118us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483087.989381:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:1.0:1788483087.995332:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483087.995416:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087117440 00000100:00100000:0.0:1788483087.995425:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087117440 00000100:00100000:0.0:1788483087.995490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 229 00000100:00100000:0.0:1788483087.995500:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:12482:x1875360087117440:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483087.995530:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483087.995555:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b4d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.995665:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.995681:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.995700:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.995742:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483087.995754:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 66 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483087.995767:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098707072:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483087.995852:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788483088.002326:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483088.002451:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098707072:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483088.002477:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.002597:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087117568 00000100:00100000:3.0:1788483088.002604:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087117568 00010000:00010000:3.0:1788483088.002660:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 67 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.002706:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 99 00000100:00100000:3.0:1788483088.002737:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:2392:x1875360087117568:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483088.002751:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483088.002757:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 67 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.002769:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 67 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.002790:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b4a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e58d expref: 67 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.002825:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00000100:00080000:2.0:1788483088.003126:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788483088.003251:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.003261:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.003269:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.003289:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483088.003390:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:2392:x1875360087117568:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 675us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483088.003398:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 99 00010000:00010000:0.0:1788483088.003540:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.003548:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483088.003577:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788483088.003705:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b4d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 67 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.003737:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.003745:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:0.0:1788483088.003747:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788483088.003749:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8000, rc 0) 00000100:00100000:0.0:1788483088.003776:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:12482:x1875360087117440:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 8277us (8453us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788483088.003783:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 229 00000100:00100000:0.0:1788483088.011807:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.012069:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087117824 00000100:00100000:2.0:1788483088.012078:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087117824 00000100:00100000:2.0:1788483088.012299:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:2.0:1788483088.012310:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:12482:x1875360087117824:12345-192.168.206.54@tcp:103:lfs.0 00010000:00010000:2.0:1788483088.012325:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483088.012349:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b42c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e571 expref: 66 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.012366:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483088.012370:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483088.012426:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:12482:x1875360087117824:12345-192.168.206.54@tcp:103:lfs.0 Request processed in 118us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483088.012433:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:3.0:1788483088.014871:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.015198:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087117952 00000100:00100000:0.0:1788483088.015207:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087117952 00000100:00100000:0.0:1788483088.015258:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 230 00000100:00100000:0.0:1788483088.015267:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:12482:x1875360087117952:12345-192.168.206.54@tcp:58:lfs.0 00010000:00010000:0.0:1788483088.015368:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.015384:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.015395:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483088.015487:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788483088.015586:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:12482:x1875360087117952:12345-192.168.206.54@tcp:58:lfs.0 Request processed in 319us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.015593:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 230 00000100:00100000:0.0:1788483088.022255:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.022345:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087118080 00000100:00100000:2.0:1788483088.022355:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087118080 00000100:00100000:2.0:1788483088.022444:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 231 00000100:00100000:2.0:1788483088.022455:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+65:12482:x1875360087118080:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483088.022473:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483088.022491:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5a9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.022780:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.022792:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 66 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.022810:0:8434:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.022824:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 66 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.022847:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483088.022851:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483088.022855:0:8434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 66 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.022863:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1a00, rc 0) 00000100:00100000:2.0:1788483088.024050:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:12482:x1875360087118080:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 642us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483088.024062:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 231 00000040:00080000:2.0:1788483088.120895:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483088.120904:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483088.121058:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788483088.121066:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788483088.121215:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098707200:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788483088.121332:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788483088.127478:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.127807:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087118208 00000100:00100000:0.0:1788483088.127818:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087118208 00000100:00100000:0.0:1788483088.127877:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 232 00000100:00100000:0.0:1788483088.127887:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087118208:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788483088.127915:0:6494:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788483088.128082:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087118208:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 196us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.128089:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 232 00000100:00100000:2.0:1788483088.129564:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098707200:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788483088.133537:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483088.133625:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087118336 00000100:00100000:1.0:1788483088.133636:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087118336 00000100:00100000:1.0:1788483088.133705:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 233 00000100:00100000:1.0:1788483088.133724:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:12483:x1875360087118336:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788483088.133798:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133815:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133826:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133896:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133905:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133912:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133947:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133969:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.133977:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483088.134021:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788483088.134026:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483088.134038:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134048:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134055:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134063:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134068:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483088.134072:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134079:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134091:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:1.0:1788483088.134117:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483088.134122:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134138:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27600/0x1d7ea3d89ea1b4f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134150:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134156:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134162:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134167:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483088.134170:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134176:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134182:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9a69f63d2900) 00010000:00010000:1.0:1788483088.134185:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483088.134187:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134193:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1b4fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134204:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134209:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134219:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134224:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483088.134226:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134232:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134238:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483088.134240:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483088.134243:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.134249:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27200/0x1d7ea3d89ea1b505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483088.134326:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:12483:x1875360087118336:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 Request processed in 613us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483088.134333:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 233 00000100:00100000:1.0:1788483088.140496:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.140735:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087118592 00000100:00100000:0.0:1788483088.140746:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087118592 00000100:00100000:0.0:1788483088.140807:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 234 00000100:00100000:0.0:1788483088.140817:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+66:12483:x1875360087118592:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483088.140839:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483088.140865:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b50c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5b0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.140975:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.140990:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141002:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483088.141028:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788483088.141485:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141494:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141501:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141508:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483088.141513:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141520:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141533:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:0.0:1788483088.141537:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788483088.141541:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141548:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141589:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b50c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5b0 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141600:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:0.0:1788483088.141603:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483088.141615:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b50c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5b0 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.141625:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8600, rc 0) 00000100:00100000:0.0:1788483088.141789:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087118592:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 972us (1301us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788483088.141797:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 234 00000100:00100000:1.0:1788483088.148669:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.149040:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087118720 00000100:00100000:0.0:1788483088.149049:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087118720 00000100:00100000:0.0:1788483088.149186:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 235 00000100:00100000:0.0:1788483088.149197:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087118720:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788483088.149231:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788483088.149398:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087118720:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 202us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.149406:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 235 00000100:00100000:1.0:1788483088.153846:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.154198:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087118976 00000100:00100000:3.0:1788483088.154208:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087118976 00000100:00100000:3.0:1788483088.154372:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 236 00000100:00100000:3.0:1788483088.154383:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087118976:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483088.154403:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483088.154406:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788483088.154432:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b4b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e594 expref: 67 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.154451:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:3.0:1788483088.154456:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483088.154483:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b521 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5b7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788483088.154880:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788483088.155023:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.155036:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.155045:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.155142:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b521 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5b7 expref: 69 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.155159:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5b7 expref: 68 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.155167:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c1c53400) 00010000:00010000:3.0:1788483088.155169:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483088.155172:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3e00, rc 0) 00000100:00100000:3.0:1788483088.155226:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:12483:x1875360087118976:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 844us (1396us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788483088.155233:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 236 00000100:00100000:1.0:1788483088.161954:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.162557:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087119232 00000100:00100000:2.0:1788483088.162567:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087119232 00000100:00100000:2.0:1788483088.162656:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 237 00000100:00100000:2.0:1788483088.162668:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:12483:x1875360087119232:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483088.162743:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483088.162768:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5b7 expref: 68 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.162786:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c1c53400) 00010000:00010000:2.0:1788483088.162797:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483088.162816:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.162829:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.162848:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.162906:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.162941:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.162949:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.162989:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163007:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163013:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163019:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483088.163023:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163030:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163039:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483088.163042:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483088.163046:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163052:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b536 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163062:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163075:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163081:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163086:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483088.163089:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163111:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163121:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x2effcf3c (ffff9a69c591a100) 00010000:00010000:2.0:1788483088.163123:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483088.163126:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.163132:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b53d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2effcf3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.163210:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087119232:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 544us (1265us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788483088.163217:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 237 00000100:00100000:1.0:1788483088.166903:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.167054:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087119360 00000100:00100000:0.0:1788483088.167063:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087119360 00000100:00100000:0.0:1788483088.167137:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 238 00000100:00100000:0.0:1788483088.167147:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+67:12483:x1875360087119360:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483088.167165:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483088.167186:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b544 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.167217:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.167229:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.167252:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.167370:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 69 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.167389:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.167398:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:0.0:1788483088.167400:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483088.167404:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8c00, rc 0) 00000100:00100000:0.0:1788483088.167463:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:12483:x1875360087119360:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 317us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.167469:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 238 00000100:00100000:1.0:1788483088.171648:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.171814:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087119616 00000100:00100000:3.0:1788483088.171825:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087119616 00000100:00100000:3.0:1788483088.172062:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 239 00000100:00100000:3.0:1788483088.172072:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+68:12483:x1875360087119616:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788483088.172191:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.172207:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.172217:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483088.172370:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788483088.172379:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380435281773ns, next at 381435279528ns, rc = 0 00000004:00010000:3.0:1788483088.172425:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006085e0fd reply state 00000000bbd23a1f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.172436:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.172444:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.172447:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788483088.172451:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483088.172534:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+70:12483:x1875360087119616:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 464us (895us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788483088.172541:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 239 00000100:00100000:1.0:1788483088.175733:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.175814:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087119744 00000100:00100000:3.0:1788483088.175824:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087119744 00000100:00100000:3.0:1788483088.175891:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 240 00000100:00100000:3.0:1788483088.175900:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+70:12483:x1875360087119744:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483088.175923:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483088.175954:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5c5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.176026:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 71 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.176041:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 71 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.176061:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.176064:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483088.176068:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3800, rc 0) 00000100:00100000:3.0:1788483088.176169:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+71:12483:x1875360087119744:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 269us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483088.176177:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 240 00000100:00100000:1.0:1788483088.180038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.180264:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087119872 00000100:00100000:3.0:1788483088.180274:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087119872 00000100:00080000:1.0:1788483088.180375:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483088.180474:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:3.0:1788483088.180486:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2392:x1875360087119872:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788483088.180756:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:2392:x1875360087119872:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 271us (725us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788483088.180765:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:2.0:1788483088.183649:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.183806:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087120128 00000100:00100000:3.0:1788483088.183815:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087120128 00000100:00100000:3.0:1788483088.184021:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:3.0:1788483088.184032:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+71:12483:x1875360087120128:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788483088.184265:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+72:12483:x1875360087120128:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 234us (623us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788483088.184281:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:1.0:1788483088.191015:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.191233:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087120384 00000100:00100000:2.0:1788483088.191244:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087120384 00000100:00100000:2.0:1788483088.191345:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 241 00000100:00100000:2.0:1788483088.191356:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+72:12483:x1875360087120384:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788483088.191489:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+72:12483:x1875360087120384:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 134us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483088.191497:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 241 00000100:00100000:1.0:1788483088.194608:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.194704:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087120512 00000100:00100000:3.0:1788483088.194725:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087120512 00000100:00100000:3.0:1788483088.194779:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 242 00000100:00100000:3.0:1788483088.194789:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+72:12483:x1875360087120512:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483088.194807:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483088.194826:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b560 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5cc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.194905:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b567 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.194918:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.195128:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483088.195174:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483088.195193:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.195219:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b560 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5cc expref: 74 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.195236:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b567 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5cc expref: 73 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.195245:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.195260:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788483088.195264:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3e00, rc 0) 00000100:00100000:3.0:1788483088.195320:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+73:12483:x1875360087120512:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 532us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483088.195328:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 242 00000100:00100000:1.0:1788483088.198731:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.198826:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087120640 00000100:00100000:0.0:1788483088.198845:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087120640 00000100:00100000:0.0:1788483088.198901:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:0.0:1788483088.198911:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+10:2393:x1875360087120640:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483088.198937:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483088.198956:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5d3 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483088.198980:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a160f, blocks: 0x0 00010000:00010000:0.0:1788483088.198999:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1788483088.199004:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483088.199028:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 11 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.199048:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 11 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.199061:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8600, rc 0) 00000100:00100000:0.0:1788483088.199146:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:2393:x1875360087120640:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 237us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.199153:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:1.0:1788483088.202624:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.202724:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087120896 00000100:00100000:3.0:1788483088.202734:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087120896 00000100:00100000:3.0:1788483088.202791:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 243 00000100:00100000:3.0:1788483088.202801:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+73:12483:x1875360087120896:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788483088.202912:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+73:12483:x1875360087120896:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 112us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483088.202920:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 243 00000100:00100000:1.0:1788483088.206538:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.206626:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087121024 00000100:00100000:0.0:1788483088.206636:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087121024 00000100:00100000:0.0:1788483088.206696:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 72 00000100:00100000:0.0:1788483088.206706:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:12483:x1875360087121024:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483088.206730:0:8551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483088.206747:0:8551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5da expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.206775:0:8551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 12 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.206784:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483088.206788:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483088.206792:0:8551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 12 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.206825:0:8551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 12 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.206860:0:8551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 12 pid: 8412 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.206874:0:8551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8551:1875360098707328:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483088.207166:0:8551:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483088.210824:0:8551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8551:1875360098707328:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483088.210864:0:8551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 12 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.210882:0:8551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9000, rc 0) 00000100:00100000:0.0:1788483088.211049:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:12483:x1875360087121024:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 4343us (4516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.211057:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 72 00000100:00100000:1.0:1788483088.213546:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.213639:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087121152 00000100:00100000:0.0:1788483088.213648:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087121152 00010000:00010000:0.0:1788483088.213696:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 12 pid: 8412 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.213747:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 100 00000100:00100000:0.0:1788483088.213758:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:2392:x1875360087121152:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483088.213772:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483088.213794:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 12 pid: 8412 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.213827:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 12 pid: 8412 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.213860:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9bbad2d/0x1d7ea3d89ea1b56e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5d3 expref: 12 pid: 8412 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.213875:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483088.213880:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483088.213887:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 11 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.213896:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 11 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.214209:0:7436:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 11 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.214225:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7436:1875360098707456:192.168.206.54@tcp:105: 00000100:00100000:0.0:1788483088.214297:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483088.218199:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7436:1875360098707456:192.168.206.54@tcp:105: 00010000:00010000:0.0:1788483088.218227:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483088.218278:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:2392:x1875360087121152:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 4521us (4738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.218288:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 100 00000100:00100000:1.0:1788483088.221770:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.221869:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087121280 00000100:00100000:2.0:1788483088.221878:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087121280 00002000:00100000:2.0:1788483088.221938:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9a69e03e3480 x1875360087121280/t0(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:594/0 lens 504/0 e 0 to 0 dl 1788483099 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483088.221950:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69e03e3480 with x1875360087121280 ext(0->12) 00002000:00010000:2.0:1788483088.221955:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69e03e3480 00000100:00100000:2.0:1788483088.221986:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:2.0:1788483088.221995:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+11:2390:x1875360087121280:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788483088.223136:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:2390:x1875360087121280:12345-192.168.206.54@tcp:4:lhsmtool_posix.0 Request processed in 1135us (1368us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788483088.223146:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00002000:00100000:2.0:1788483088.223155:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9a69e03e3480 x1875360087121280/t4294967321(0) o4->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:594/0 lens 504/448 e 0 to 0 dl 1788483099 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483088.223165:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69e03e3480 with x1875360087121280 ext(0->12) 00002000:00010000:2.0:1788483088.223169:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69e03e3480 00000100:00100000:1.0:1788483088.225925:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.226058:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087121408 00000100:00100000:3.0:1788483088.226068:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087121408 00000100:00100000:3.0:1788483088.226161:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 244 00000100:00100000:3.0:1788483088.226173:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+73:12483:x1875360087121408:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788483088.228866:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1788483088.228881:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788483088.228925:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1788483088.229136:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098707712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788483088.229191:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483088.229222:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483088.229227:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098707584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788483088.229244:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483088.229269:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098707712 00000100:00100000:1.0:1788483088.229274:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098707712 00000100:00100000:1.0:1788483088.229313:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098707584 00000100:00100000:1.0:1788483088.229315:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098707584 00000100:00100000:1.0:1788483088.229330:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788483088.229337:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875360098707712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788483088.229438:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788483088.229442:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788483087 00002000:00010000:1.0:1788483088.229444:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788483088.229447:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788483087 -> 1788483087 00002000:00010000:1.0:1788483088.229449:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788483088.229485:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3622:x1875360098707712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (292us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788483088.229493:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788483088.229521:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788483088.229527:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875360098707584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788483088.229541:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1788483088.229558:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.229578:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 12 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.229587:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788483088.229591:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483088.229595:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.229622:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 12 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.229636:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 12 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483088.229648:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098707840:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483088.229727:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3480 going to sleep for 11 seconds 00000100:00080000:1.0:1788483088.229740:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788483088.229769:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69e03e3b80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788483088.229775:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098707712:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788483088.230199:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a69ed97a6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788483088.230203:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69c3874d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a69ed97af00 00000020:00080000:0.0:1788483088.230206:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69c3874a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c27e5800 00000004:00080000:0.0:1788483088.230239:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788483088.230263:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a69d01b3e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788483088.230266:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a68c3648300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a69d01b3900 00000020:00080000:0.0:1788483088.230269:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a68c3648c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a69ece78a00 00000020:00080000:2.0:1788483088.230464:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788483088.230512:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1788483088.230635:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230645:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230653:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230659:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483088.230663:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230694:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230718:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68c1c53c00) 00010000:00010000:3.0:1788483088.230722:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483088.230727:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230733:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b27a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230761:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230767:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230773:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230778:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483088.230780:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230787:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230794:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68c3183300) 00010000:00010000:3.0:1788483088.230797:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483088.230800:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230815:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b322 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230844:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230852:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230857:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230862:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483088.230864:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230870:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230878:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:3.0:1788483088.230881:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483088.230883:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230889:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1b3a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230900:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230906:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230918:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.230922:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483088.230926:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231043:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231052:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591aa00) 00010000:00010000:3.0:1788483088.231054:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483088.231057:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231063:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b3c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231081:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231087:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231093:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231183:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483088.231187:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231203:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231212:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:3.0:1788483088.231215:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483088.231218:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231224:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b495 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231236:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231242:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231248:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231252:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483088.231255:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231261:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231267:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.231270:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788483088.231273:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.231287:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b552 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.231406:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12483:x1875360087121408:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 Request processed in 5231us (5485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483088.231415:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 244 00000100:00100000:1.0:1788483088.231563:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483088.231628:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098707968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788483088.231671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483088.231733:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098707968 00000100:00100000:1.0:1788483088.231739:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098707968 00000100:00100000:1.0:1788483088.231773:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788483088.231782:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098707968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788483088.231806:0:8551:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1788483088.231833:0:8551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a160e, atime: 0x6a9a160e, ctime: 0x6a9a160e, blocks: 0x8 00010000:00010000:1.0:1788483088.231839:0:8551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.231852:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1788483088.231856:0:8551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483088.231862:0:8551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.231877:0:8551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.231886:0:8551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.231894:0:8551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.231918:0:8551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788483088.232241:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3620:x1875360098707968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 460us (568us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788483088.232257:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1788483088.232296:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69e03e0380/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788483088.232302:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098707968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788483088.233731:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483088.233743:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.233755:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483088.233760:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.233770:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.233791:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.233798:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b583 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.233845:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483088.233847:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483088.233849:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483088.237207:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483088.237254:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.237365:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1875360098707840:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483088.237393:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.237470:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087121664 00000100:00100000:3.0:1788483088.237478:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087121664 00010000:00010000:3.0:1788483088.237515:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 13 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.237554:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 101 00000100:00100000:3.0:1788483088.237563:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+13:2392:x1875360087121664:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483088.237576:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483088.237583:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 13 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.237595:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 13 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.237617:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1b330 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e532 expref: 13 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.237633:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483088.237638:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483088.237654:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.237664:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.237697:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483088.237756:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:2392:x1875360087121664:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 193us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483088.237763:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 101 00010000:00010000:1.0:1788483088.238258:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.238268:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.238277:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.238285:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.238303:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788483088.238471:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3622:x1875360098707584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8943us (9224us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788483088.238479:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788483088.238498:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087121536 00000100:00100000:1.0:1788483088.238503:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087121536 00000100:00100000:1.0:1788483088.238529:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 76 00000100:00100000:1.0:1788483088.238536:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+12:2392:x1875360087121536:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788483088.238885:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69e03e2a00/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788483088.238893:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098707584:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788483088.239267:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483088.239274:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.239284:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483088.239289:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.239299:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.239316:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.239324:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b57c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.239357:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483088.239359:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483088.239361:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788483088.241513:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788483088.241531:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1788483088.241746:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087121536:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 Request processed in 3205us (4486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483088.241758:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 76 00000100:00100000:1.0:1788483088.246446:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.246531:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087121920 00000100:00100000:3.0:1788483088.246540:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087121920 00000100:00100000:3.0:1788483088.246631:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 245 00000100:00100000:3.0:1788483088.246642:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12483:x1875360087121920:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788483088.246701:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483088.246738:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b567 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5cc expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.246755:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.246759:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483088.246784:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.246795:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.246803:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483088.246922:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c77f20b reply state 00000000f5b951bb transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.247049:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.247071:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.247073:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483088.247075:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483088.247465:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:12483:x1875360087121920:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 822us (1024us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788483088.247482:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 245 00000100:00100000:3.0:1788483088.250072:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.250228:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087122048 00000100:00100000:0.0:1788483088.250237:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087122048 00000100:00100000:0.0:1788483088.250286:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 77 00000100:00100000:0.0:1788483088.250294:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087122048:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788483088.250430:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788483088.250434:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788483087 -> 1788483087 00002000:00010000:0.0:1788483088.250436:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788483086 00002000:00010000:0.0:1788483088.250438:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788483087 -> 1788483087 00002000:00010000:0.0:1788483088.250440:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788483088.250492:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087122048:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 198us (426us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788483088.250498:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 77 00000100:00100000:1.0:1788483088.253308:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.253402:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087122304 00000100:00100000:2.0:1788483088.253411:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087122304 00000100:00100000:2.0:1788483088.253489:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 246 00000100:00100000:2.0:1788483088.253499:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:12483:x1875360087122304:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788483088.253559:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.253576:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.253584:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.253617:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.253630:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 22 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.253643:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098708096:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483088.253826:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483088.259686:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.259830:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087122432 00000100:00100000:0.0:1788483088.259847:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087122432 00010000:00010000:0.0:1788483088.259892:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 23 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.259955:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 102 00000100:00100000:0.0:1788483088.259965:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:2392:x1875360087122432:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483088.259979:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483088.259987:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 23 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.259999:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 23 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.260021:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:0.0:1788483088.260026:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.260036:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.260044:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.260062:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483088.260136:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+23:2392:x1875360087122432:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 173us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.260144:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 102 00010000:00010000:3.0:1788483088.261678:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b54b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5be expref: 22 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.261720:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8434:1875360098708096:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483088.261751:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.261761:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.261767:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.261808:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.261815:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.261822:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.261826:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483088.262020:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.262047:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.262062:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.262065:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788483088.262069:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.262074:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b591 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.262159:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12483:x1875360087122304:12345-192.168.206.54@tcp:55:lhsmtool_posix.0 Request processed in 8660us (8857us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788483088.262168:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 246 00000100:00100000:1.0:1788483088.265042:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.265124:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087122560 00000100:00100000:2.0:1788483088.265133:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087122560 00000100:00100000:2.0:1788483088.265183:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 78 00000100:00100000:2.0:1788483088.265193:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2391:x1875360087122560:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788483088.265251:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.265270:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 8 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.265278:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483088.265283:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483088.265287:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.265320:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 8 pid: 8551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.265334:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 8 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.265348:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875360098708224:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483088.265976:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed97a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483088.275398:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.275479:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087122688 00000100:00100000:3.0:1788483088.275489:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087122688 00010000:00010000:3.0:1788483088.275533:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 9 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.275578:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 103 00000100:00100000:3.0:1788483088.275588:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2393:x1875360087122688:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483088.275603:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483088.275625:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 9 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.275640:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 9 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.275697:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483088.275702:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483088.275709:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.275728:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.275749:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483088.275813:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+9:2393:x1875360087122688:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 226us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483088.275820:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 103 00010000:00010000:2.0:1788483088.277170:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1b575 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5da expref: 8 pid: 8551 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.277191:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875360098708224:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483088.277228:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277269:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277278:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277302:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277310:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277318:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277325:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483088.277329:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277338:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277354:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.277373:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e7d0b8/0x1d7ea3d89ea1b598 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.277450:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087122560:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 Request processed in 12258us (12414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483088.277459:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 78 00000100:00100000:1.0:1788483088.292225:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.292370:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087122944 00000100:00100000:0.0:1788483088.292380:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087122944 00000100:00100000:0.0:1788483088.292438:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 247 00000100:00100000:0.0:1788483088.292448:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:12483:x1875360087122944:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788483088.292532:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.292549:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.292558:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.292595:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.292610:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 21 pid: 6495 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.292623:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098708352:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483088.292706:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483088.296407:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.296575:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098708352:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483088.296604:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483088.296681:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087123072 00000100:00100000:1.0:1788483088.296699:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087123072 00010000:00010000:1.0:1788483088.296744:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 22 pid: 6495 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483088.296780:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 104 00000100:00100000:1.0:1788483088.296790:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:2393:x1875360087123072:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483088.296813:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483088.296821:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 22 pid: 6495 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.296833:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 22 pid: 6495 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.296861:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3600/0x1d7ea3d89ea1b48e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e586 expref: 22 pid: 6495 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.296878:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483088.296898:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 21 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.296907:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.296914:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.296921:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.298575:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483088.298648:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:2393:x1875360087123072:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 1853us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483088.298657:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 104 00010000:00010000:2.0:1788483088.305043:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.305060:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.309221:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.309245:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.309351:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.309407:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.309422:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 21 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.309437:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098708480:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483088.309568:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483088.320614:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.321138:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087123200 00000100:00100000:3.0:1788483088.321147:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087123200 00010000:00010000:3.0:1788483088.321183:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 22 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483088.321230:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 105 00000100:00100000:3.0:1788483088.321240:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:2392:x1875360087123200:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483088.321254:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483088.321262:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 22 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.321275:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 22 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.321312:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:3.0:1788483088.321318:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.321327:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483088.321333:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.321456:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e3800/0x1d7ea3d89ea1b559 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5c5 expref: 22 pid: 6494 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.321474:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098708480:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483088.321480:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483088.321493:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.321500:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.321505:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.321533:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:2392:x1875360087123200:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 294us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483088.321540:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 105 00000001:00080000:0.0:1788483088.321619:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788483088.321753:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1788483088.321792:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788483088.321871:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098708608:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788483088.321924:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483088.321952:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483088.322083:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098708608 00000100:00100000:2.0:1788483088.322090:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098708608 00000100:00100000:2.0:1788483088.322159:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788483088.322167:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1875360098708608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788483088.322244:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1875360098708608:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483088.322250:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788483088.323018:0:6493:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788483088.323025:0:6493:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1788483088.323041:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69e03e3b80, transno 4294967322 00000004:00080000:0.0:1788483088.323058:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69e03e2a00, transno 4294967323 00000100:00100000:0.0:1788483088.323065:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098708608:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788483088.323195:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788483088.323248:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098708736:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788483088.323285:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483088.323316:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788483088.323418:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098708736 00000100:00100000:2.0:1788483088.323424:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098708736 00000100:00100000:2.0:1788483088.323468:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788483088.323486:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1875360098708736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788483088.323593:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6493:x1875360098708736:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (307us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788483088.323600:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788483088.323819:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875360098708736:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788483088.323855:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.323865:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.323872:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.323878:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483088.323883:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.323902:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.323917:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:1.0:1788483088.323919:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483088.323924:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324053:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b5a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324078:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324084:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324090:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324117:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483088.324121:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324127:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324136:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483088.324138:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483088.324145:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 24 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324167:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 24 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324176:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 24 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.324203:0:6493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 24 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483088.324215:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098708864:192.168.206.54@tcp:105: 00000100:00100000:1.0:1788483088.324654:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483088.345242:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.345317:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875360098708864:192.168.206.54@tcp:105: 00000100:00100000:2.0:1788483088.345328:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087123328 00000100:00100000:2.0:1788483088.345334:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087123328 00010000:00010000:0.0:1788483088.345346:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345356:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b4e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.345385:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00010000:00010000:0.0:1788483088.345385:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.345394:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:12482:x1875360087123328:12345-192.168.206.54@tcp:49:lfs.0 00010000:00010000:0.0:1788483088.345399:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345422:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345431:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345437:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345457:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345462:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483088.345466:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345472:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345483:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:0.0:1788483088.345485:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483088.345488:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345493:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1b5ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345502:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345509:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.345513:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:12482:x1875360087123328:12345-192.168.206.54@tcp:49:lfs.0 Request processed in 119us (279us total) trans 0 rc 0/0 00010000:00010000:0.0:1788483088.345515:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345520:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8a00 already unused, calling callback (ffffffffc1a904f0) 00000100:00100000:2.0:1788483088.345521:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00010000:00010000:0.0:1788483088.345523:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345537:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345546:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:0.0:1788483088.345549:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483088.345552:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483088.345557:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b59f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483088.345693:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:12483:x1875360087122944:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 53246us (53476us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788483088.345701:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 247 00000020:00080000:0.0:1788483088.345704:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788483088.345894:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483088.345900:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483088.346530:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788483088.346541:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788483088.352696:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.352828:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087123584 00000100:00100000:3.0:1788483088.352847:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087123584 00000100:00100000:3.0:1788483088.352917:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 248 00000100:00100000:3.0:1788483088.352938:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+24:12482:x1875360087123584:12345-192.168.206.54@tcp:58:lfs.0 00000100:00100000:1.0:1788483088.357281:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.358188:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087123840 00000100:00100000:2.0:1788483088.358198:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087123840 00000100:00100000:2.0:1788483088.358267:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:2.0:1788483088.358279:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4620c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+25:12483:x1875360087123840:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788483088.358515:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788483088.358546:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788483088.358583:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.358598:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.358608:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.358630:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.358636:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.358643:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.358674:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788483088.358770:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4620c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12483:x1875360087123840:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 493us (1497us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788483088.358779:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 62 00000020:00080000:2.0:1788483088.358783:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788483088.359788:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483088.359807:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.359815:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483088.359820:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.359829:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.359852:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:1.0:1788483088.359855:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788483088.359859:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.359874:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5b4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.359889:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483088.359890:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483088.359892:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483088.366882:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788483088.367225:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+26:12482:x1875360087123584:12345-192.168.206.54@tcp:58:lfs.0 Request processed in 14293us (14542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.367235:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 248 00000100:00100000:1.0:1788483088.440547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.440648:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087123968 00000100:00100000:2.0:1788483088.440657:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087123968 00000100:00100000:2.0:1788483088.440733:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 249 00000100:00100000:2.0:1788483088.440743:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+26:12485:x1875360087123968:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483088.440764:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483088.440782:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b5bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5e1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.440854:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.440869:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.440881:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.440909:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.440917:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.440924:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.441004:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.441015:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.441023:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.441055:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.441067:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 27 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483088.441080:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875360098708992:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483088.441235:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c690a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483088.448393:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875360098708992:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483088.448425:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483088.452366:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483088.452976:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087124224 00000100:00100000:3.0:1788483088.452991:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087124224 00000100:00100000:3.0:1788483088.453213:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:3.0:1788483088.453227:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:6163:x1875360087124224:12345-192.168.206.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788483088.453631:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:6163:x1875360087124224:12345-192.168.206.54@tcp:35:ldlm_bl.0 Request processed in 406us (1281us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788483088.453641:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:2.0:1788483088.458204:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483088.458305:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087124352 00000100:00100000:1.0:1788483088.458319:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087124352 00010000:00010000:1.0:1788483088.458376:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 29 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483088.458516:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 106 00000100:00100000:1.0:1788483088.458529:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:2393:x1875360087124352:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483088.458548:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483088.458557:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 29 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.458573:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 29 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.458603:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b4db lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a2 expref: 29 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.458624:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483088.458630:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.458657:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.458665:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483088.459019:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483088.459141:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:2393:x1875360087124352:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 568us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483088.459150:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 106 00010000:00010000:2.0:1788483088.460652:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.460983:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483088.461056:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788483088.461061:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483088.461085:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461190:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461203:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461210:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461218:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461224:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483088.461228:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461236:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461252:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:2.0:1788483088.461309:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483088.461329:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461364:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461388:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461394:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461401:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461405:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483088.461410:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461417:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461432:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a69c591a100) 00010000:00010000:2.0:1788483088.461435:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483088.461438:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461444:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461492:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b5bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5e1 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461508:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5e1 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483088.461522:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483088.461525:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483088.461527:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1400, rc 0) 00000100:00100000:2.0:1788483088.461605:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12485:x1875360087123968:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 20863us (21068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483088.461613:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 249 00010000:00010000:0.0:1788483088.507588:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483088.529204:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.529511:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.529547:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.529578:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483088.529601:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483088.529700:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087124736 00000100:00100000:0.0:1788483088.529718:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087124736 00000100:00100000:0.0:1788483088.529778:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:0.0:1788483088.529808:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087124736:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483088.529880:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087124736:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.529888:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:0.0:1788483088.530004:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087124608 00000100:00100000:0.0:1788483088.530008:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087124608 00000100:00100000:0.0:1788483088.530038:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087124864 00000100:00100000:0.0:1788483088.530041:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087124864 00000100:00100000:0.0:1788483088.530055:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087124992 00000100:00100000:0.0:1788483088.530058:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087124992 00000100:00100000:0.0:1788483088.530073:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 345 00000100:00100000:0.0:1788483088.530079:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087124608:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483088.530188:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087124608:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 108us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.530207:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 345 00000100:00100000:0.0:1788483088.530229:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 346 00000100:00100000:0.0:1788483088.530236:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087124864:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483088.530262:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087124864:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.530268:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 346 00000100:00100000:0.0:1788483088.530279:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 347 00000100:00100000:0.0:1788483088.530285:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087124992:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483088.530307:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087124992:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 22us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483088.530312:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 347 00000100:00100000:1.0:1788483088.530864:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087124480 00000100:00100000:1.0:1788483088.530870:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087124480 00000100:00100000:1.0:1788483088.530915:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 395 00000100:00100000:1.0:1788483088.530924:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087124480:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483088.531005:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087124480:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 83us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483088.531011:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 395 00000100:00080000:1.0:1788483088.531039:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483088.531043:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788483089.165785:0:14786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483089.165795:0:14786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483089.165904:0:14786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788483089.165913:0:14786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788483089.400622:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483089.400630:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483089.400656:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788483089.400665:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788483089.400811:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098709120:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788483089.401029:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483089.404982:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483089.407340:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087125120 00000100:00100000:1.0:1788483089.407355:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087125120 00000100:00100000:1.0:1788483089.407422:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 250 00000100:00100000:1.0:1788483089.407434:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:12497:x1875360087125120:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483089.407469:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788483089.407598:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+28:12497:x1875360087125120:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 165us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483089.407606:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 250 00000100:00100000:2.0:1788483089.409032:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1875360098709120:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788483089.411065:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483089.411412:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087125376 00000100:00100000:2.0:1788483089.411426:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087125376 00000100:00100000:2.0:1788483089.411497:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 251 00000100:00100000:2.0:1788483089.411508:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+27:12497:x1875360087125376:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483089.411526:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483089.411545:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483089.411663:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483089.411677:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483089.411689:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483089.411700:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788483089.411814:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1b5d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5e8 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483089.411984:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5e8 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483089.411995:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483089.411997:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483089.412001:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1e00, rc 0) 00000100:00100000:2.0:1788483089.412123:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:12497:x1875360087125376:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 617us (1071us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788483089.412132:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 251 00000100:00100000:3.0:1788483089.431438:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483089.431503:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483089.431548:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087125632 00000100:00100000:1.0:1788483089.431563:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087125632 00000100:00100000:1.0:1788483089.431635:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 252 00000100:00100000:1.0:1788483089.431645:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:12497:x1875360087125632:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788483089.431739:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431756:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431767:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431943:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431950:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431956:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431962:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483089.431966:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431974:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.431986:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483089.431989:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483089.432008:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483089.432015:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1b5ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483089.432180:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:12497:x1875360087125632:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 535us (758us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788483089.432188:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 252 00000100:00100000:2.0:1788483089.432595:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087125760 00000100:00100000:2.0:1788483089.432602:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087125760 00000100:00100000:2.0:1788483089.432646:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:2.0:1788483089.432654:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:2391:x1875360087125760:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483089.432665:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483089.432687:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5e8 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483089.432700:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483089.432717:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483089.432757:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:2391:x1875360087125760:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 103us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483089.432765:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000040:00080000:3.0:1788483089.432998:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483089.433007:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483089.433773:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788483089.433788:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788483089.440025:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483089.440321:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087126016 00000100:00100000:2.0:1788483089.440331:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087126016 00000100:00100000:2.0:1788483089.440382:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:2.0:1788483089.440393:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+29:12497:x1875360087126016:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483089.441496:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:12497:x1875360087126016:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 1099us (1475us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788483089.441508:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00010000:00010000:3.0:1788483089.528405:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483089.657575:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483089.657598:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098709248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483089.657664:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483089.657800:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098709248 00000100:00100000:1.0:1788483089.657809:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098709248 00000100:00100000:1.0:1788483089.657868:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788483089.657876:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098709248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483089.657906:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788483089.657949:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098709248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483089.657956:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788483089.658031:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098709248:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788483090.552200:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483090.681269:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098709376:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681341:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681387:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098709888:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681413:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681438:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098710400:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681461:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681477:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098710912:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681494:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681515:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788483090.681521:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098709504:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681582:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681613:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098710016:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681633:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681648:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098710528:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681666:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681695:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098709632:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681730:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681747:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098710144:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681766:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681781:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098710656:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681800:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681813:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788483090.681819:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098709760:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681851:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681862:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098710272:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681884:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681900:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098710784:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.681930:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483090.681963:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710400 00000100:00100000:2.0:1788483090.681969:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710400 00000100:00100000:2.0:1788483090.682009:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710912 00000100:00100000:2.0:1788483090.682013:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710912 00000100:00100000:2.0:1788483090.682025:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710272 00000100:00100000:2.0:1788483090.682027:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710272 00000100:00100000:2.0:1788483090.682038:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710784 00000100:00100000:2.0:1788483090.682041:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710784 00000100:00100000:2.0:1788483090.682067:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788483090.682075:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098710400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682146:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098710400:12345-0@lo:400:kworker.0 Request processed in 72us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682153:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788483090.682170:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788483090.682177:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098710912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682204:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098710912:12345-0@lo:400:kworker.0 Request processed in 28us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682210:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788483090.682221:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788483090.682226:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098710272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682253:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098710272:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682259:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788483090.682269:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788483090.682275:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098710784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682299:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098710784:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682304:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788483090.682320:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098709504 00000100:00100000:2.0:1788483090.682323:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098709504 00000100:00100000:2.0:1788483090.682339:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710016 00000100:00100000:2.0:1788483090.682341:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710016 00000100:00100000:2.0:1788483090.682353:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710528 00000100:00100000:2.0:1788483090.682356:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710528 00000100:00100000:2.0:1788483090.682366:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710144 00000100:00100000:2.0:1788483090.682375:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710144 00000100:00100000:2.0:1788483090.682390:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098710656 00000100:00100000:2.0:1788483090.682393:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098710656 00000100:00100000:2.0:1788483090.682404:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098709760 00000100:00100000:2.0:1788483090.682407:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098709760 00000100:00100000:2.0:1788483090.682420:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788483090.682425:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098709504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682456:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098709504:12345-0@lo:400:kworker.0 Request processed in 31us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682462:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788483090.682474:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788483090.682480:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098710016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682503:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098710016:12345-0@lo:400:kworker.0 Request processed in 24us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682508:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788483090.682518:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788483090.682523:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098710528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682545:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098710528:12345-0@lo:400:kworker.0 Request processed in 22us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682550:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788483090.682561:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788483090.682568:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098710144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682592:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098710144:12345-0@lo:400:kworker.0 Request processed in 26us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682598:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788483090.682608:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788483090.682614:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098710656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682648:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098710656:12345-0@lo:400:kworker.0 Request processed in 34us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682654:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788483090.682666:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788483090.682672:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098709760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682711:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098709760:12345-0@lo:400:kworker.0 Request processed in 26us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483090.682718:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788483090.682755:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098709760:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682766:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098710272:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682775:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098710784:0@lo:400:kworker.0 00010000:00080000:2.0:1788483090.682786:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c59e4000 x1875360098710144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483090.682797:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098710144:0@lo:400:kworker.0 00010000:00080000:2.0:1788483090.682806:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69e03e3b80 x1875360098710656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483090.682814:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098710656:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682851:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098709504:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682861:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098710016:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682870:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098710528:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682880:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098710400:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.682900:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098710912:0@lo:400:kworker.0 00000100:00100000:1.0:1788483090.684505:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098709376 00000100:00100000:1.0:1788483090.684516:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098709376 00000100:00100000:1.0:1788483090.684567:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788483090.684575:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098709376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483090.684641:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098709376:12345-0@lo:400:kworker.0 Request processed in 68us (3300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483090.684648:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788483090.684690:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098709888 00000100:00100000:1.0:1788483090.684694:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098709888 00000100:00100000:1.0:1788483090.684729:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098709632 00000100:00100000:1.0:1788483090.684732:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098709632 00000100:00100000:1.0:1788483090.684756:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788483090.684761:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098709888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483090.684794:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098709888:12345-0@lo:400:kworker.0 Request processed in 33us (3381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483090.684799:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788483090.684811:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788483090.684816:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098709632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483090.684858:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098709632:12345-0@lo:400:kworker.0 Request processed in 42us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483090.684864:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1788483090.684882:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483090.684887:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483090.684891:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483090.684893:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483090.684933:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098709632:0@lo:400:kworker.0 00000100:00100000:1.0:1788483090.684963:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098709376:0@lo:400:kworker.0 00000100:00100000:1.0:1788483090.684974:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098709888:0@lo:400:kworker.0 00000100:00100000:2.0:1788483090.688743:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098711040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483090.688894:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483090.689487:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711040 00000100:00100000:3.0:1788483090.689496:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711040 00000100:00100000:3.0:1788483090.689544:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788483090.689552:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098711040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483090.689580:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788483090.689632:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098711040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483090.689639:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788483090.689714:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098711040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483091.197794:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098711168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483091.198021:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483091.201337:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711168 00000100:00100000:0.0:1788483091.201362:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711168 00000100:00100000:1.0:1788483091.201817:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788483091.201829:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098711168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483091.201855:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788483091.214216:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098711168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12379us (16184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483091.214230:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788483091.215385:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098711168:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788483091.285805:0:14837:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483091.285814:0:14837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483091.285842:0:14837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788483091.285848:0:14837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483091.452253:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483091.452329:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087126272 00000100:00100000:2.0:1788483091.452349:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087126272 00000100:00100000:2.0:1788483091.452420:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 253 00000100:00100000:2.0:1788483091.452430:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+30:12517:x1875360087126272:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483091.452455:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483091.452517:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5ef expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483091.452618:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b5fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483091.452633:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b5fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483091.452645:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b5fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483091.452669:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788483091.452793:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1e00/0x1d7ea3d89ea1b5f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5ef expref: 33 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483091.452812:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b5fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5ef expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483091.452821:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:2.0:1788483091.452823:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788483091.452826:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0200, rc 0) 00000100:00080000:1.0:1788483091.452914:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483091.453788:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:12517:x1875360087126272:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 1355us (1540us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788483091.453796:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 253 00000100:00100000:2.0:1788483091.473007:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483091.473469:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087126400 00000100:00100000:1.0:1788483091.473482:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087126400 00000100:00100000:1.0:1788483091.473550:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 254 00000100:00100000:1.0:1788483091.473562:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:12517:x1875360087126400:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:1.0:1788483091.473643:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473661:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473672:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473718:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473725:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473731:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473737:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483091.473742:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473749:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473762:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483091.473765:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788483091.473769:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483091.473784:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b608 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483091.473850:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:12517:x1875360087126400:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 289us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483091.473857:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 254 00000100:00100000:0.0:1788483091.570570:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483091.570686:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087126528 00000100:00100000:2.0:1788483091.570706:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087126528 00000100:00100000:2.0:1788483091.570787:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 79 00000100:00100000:2.0:1788483091.570797:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2392:x1875360087126528:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:2.0:1788483091.570816:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483091.570836:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1b60f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5f6 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483091.570860:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9a160f, atime: 0x6a9a160e, ctime: 0x6a9a160f, blocks: 0x8 00010000:00010000:2.0:1788483091.570879:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1788483091.570884:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483091.570893:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1b60f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5f6 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483091.570925:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1b60f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5f6 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483091.570939:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1e00, rc 0) 00000100:00100000:2.0:1788483091.570993:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2392:x1875360087126528:12345-192.168.206.54@tcp:101:cat.0 Request processed in 197us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483091.570999:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 79 00000100:00080000:1.0:1788483091.571131:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483091.575440:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483091.575509:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087126656 00000100:00100000:2.0:1788483091.575518:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087126656 00002000:00100000:2.0:1788483091.575566:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9a69f73f9500 x1875360087126656/t0(0) o3->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:597/0 lens 488/0 e 0 to 0 dl 1788483102 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483091.575577:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69f73f9500 with x1875360087126656 ext(0->4095) 00002000:00010000:2.0:1788483091.575583:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69f73f9500 00000100:00100000:2.0:1788483091.575625:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:2.0:1788483091.575636:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2391:x1875360087126656:12345-192.168.206.54@tcp:3:cat.0 00000100:00100000:2.0:1788483091.575809:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2391:x1875360087126656:12345-192.168.206.54@tcp:3:cat.0 Request processed in 174us (377us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788483091.575817:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00002000:00100000:2.0:1788483091.575825:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9a69f73f9500 x1875360087126656/t0(0) o3->d93ec387-f41f-455a-afdd-b6a72a2f59de@192.168.206.54@tcp:597/0 lens 488/4536 e 0 to 0 dl 1788483102 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483091.575833:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69f73f9500 with x1875360087126656 ext(0->4095) 00002000:00010000:2.0:1788483091.575837:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a69f73f9500 00010000:00010000:0.0:1788483091.576228:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483092.217207:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098711424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483092.217271:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483092.217711:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711424 00000100:00100000:0.0:1788483092.217720:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711424 00000100:00100000:3.0:1788483092.217778:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098711296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483092.217791:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788483092.217804:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098711424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483092.217834:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788483092.217877:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483092.218462:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711296 00000100:00100000:1.0:1788483092.218470:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711296 00000100:00100000:1.0:1788483092.218505:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788483092.218513:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098711296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483092.218537:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788483092.224033:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098711424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6223us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483092.224047:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788483092.224128:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483092.224253:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098711424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483092.224440:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098711552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483092.224511:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483092.224572:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711552 00000100:00100000:0.0:1788483092.224907:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711552 00000100:00100000:0.0:1788483092.224967:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788483092.224975:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098711552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483092.224995:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483092.225036:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098711552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483092.225043:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788483092.225059:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483092.225080:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098711552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483092.228111:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098711296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9579us (10216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483092.228124:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788483092.228361:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098711296:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788483092.601973:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788483092.734339:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788483092.734366:0:8405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:1.0:1788483093.624491:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483093.650826:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483093.651026:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483093.651063:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483093.651114:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483093.651143:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483093.651164:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483093.651184:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483093.651213:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087127040 00000100:00100000:2.0:1788483093.651223:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087127040 00000100:00100000:2.0:1788483093.651267:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087127552 00000100:00100000:2.0:1788483093.651270:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087127552 00000100:00100000:2.0:1788483093.651283:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087126912 00000100:00100000:2.0:1788483093.651286:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087126912 00000100:00100000:2.0:1788483093.651298:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087127424 00000100:00100000:2.0:1788483093.651301:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087127424 00000100:00100000:2.0:1788483093.651318:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 354 00000100:00100000:2.0:1788483093.651327:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087127040:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483093.651393:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087127040:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 67us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483093.651400:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 354 00000100:00100000:2.0:1788483093.651416:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 355 00000100:00100000:2.0:1788483093.651422:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087127552:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483093.651447:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087127552:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483093.651454:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 355 00000100:00100000:2.0:1788483093.651466:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 356 00000100:00100000:2.0:1788483093.651472:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:2391:x1875360087126912:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483093.651500:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+32:2391:x1875360087126912:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483093.651514:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 356 00000100:00100000:2.0:1788483093.651528:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 357 00000100:00100000:2.0:1788483093.651534:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087127424:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483093.651560:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087127424:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483093.651565:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 357 00000100:00100000:1.0:1788483093.651665:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087127296 00000100:00100000:1.0:1788483093.651670:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087127296 00000100:00100000:1.0:1788483093.651717:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087127168 00000100:00100000:1.0:1788483093.651720:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087127168 00000100:00100000:1.0:1788483093.651753:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 158 00000100:00100000:1.0:1788483093.651761:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2391:x1875360087127296:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483093.651791:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+8:2391:x1875360087127296:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483093.651804:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 158 00000100:00100000:1.0:1788483093.651817:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 159 00000100:00100000:1.0:1788483093.651824:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087127168:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483093.651859:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087127168:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483093.651865:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 159 00000100:00100000:0.0:1788483093.652256:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087126784 00000100:00100000:0.0:1788483093.652261:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087126784 00000100:00100000:0.0:1788483093.652300:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 397 00000100:00100000:0.0:1788483093.652308:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087126784:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483093.652343:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087126784:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 37us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483093.652349:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 397 00000100:00080000:0.0:1788483093.652378:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483093.652382:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483093.652385:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483093.652387:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:2.0:1788483093.760556:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1788483093.760572:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788483093.761006:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788483093.761035:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a68c3dc7f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788483093.761040:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69f4751100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c3dc7240 00000020:00080000:0.0:1788483093.761043:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69f4751900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c3186c00 00000020:00080000:0.0:1788483093.761071:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788483093.761135:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788483093.761220:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788483093.761276:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483093.761287:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483093.761294:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483093.761300:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483093.761304:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483093.761311:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483093.761329:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a68c3183800) 00010000:00010000:2.0:1788483093.761331:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483093.761336:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483093.761358:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b58a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483094.650430:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483094.777001:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098711680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483094.777075:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483094.782657:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711680 00000100:00100000:1.0:1788483094.782672:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711680 00000100:00100000:1.0:1788483094.782741:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788483094.782750:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098711680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483094.782784:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788483094.786608:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098711680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3849us (9522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483094.786632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788483094.795600:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098711680:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483095.674239:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483095.801187:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098712064:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.801290:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483095.801387:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098712576:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.801417:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483095.801437:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098713088:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.801459:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483095.801493:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788483095.801499:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098711936:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.801520:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483095.801536:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098712448:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.801557:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483095.801578:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098712960:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.801601:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483095.801631:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712576 00000100:00100000:3.0:1788483095.801938:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098711808:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.801982:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483095.802009:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098712320:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802034:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483095.802052:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098712832:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802093:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483095.802155:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098713344:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802178:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483095.802198:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788483095.802204:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098712192:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802226:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483095.802237:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098712704:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802257:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483095.802273:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098713216:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802292:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483095.802333:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713088 00000100:00100000:3.0:1788483095.802342:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713088 00000100:00100000:3.0:1788483095.802407:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711936 00000100:00100000:3.0:1788483095.802411:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711936 00000100:00100000:3.0:1788483095.802425:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712448 00000100:00100000:3.0:1788483095.802428:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712448 00000100:00100000:3.0:1788483095.802441:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712960 00000100:00100000:3.0:1788483095.802443:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712960 00000100:00100000:3.0:1788483095.802455:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712192 00000100:00100000:3.0:1788483095.802457:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712192 00000100:00100000:3.0:1788483095.802472:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788483095.802481:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098713088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802549:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098713088:12345-0@lo:400:kworker.0 Request processed in 68us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483095.802556:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788483095.802575:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788483095.802581:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098711936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802606:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098711936:12345-0@lo:400:kworker.0 Request processed in 26us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483095.802622:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788483095.802634:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788483095.802653:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098712448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802845:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098712448:12345-0@lo:400:kworker.0 Request processed in 205us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483095.802851:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788483095.802864:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788483095.802870:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098712960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.802899:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098712960:12345-0@lo:400:kworker.0 Request processed in 30us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483095.802905:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788483095.802917:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788483095.802923:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098712192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803326:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712064 00000100:00100000:1.0:1788483095.803333:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712064 00000100:00100000:1.0:1788483095.803378:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712320 00000100:00100000:1.0:1788483095.803382:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712320 00000100:00100000:1.0:1788483095.803398:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788483095.803405:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098712064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803451:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098712064:12345-0@lo:400:kworker.0 Request processed in 47us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483095.803458:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788483095.803483:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788483095.803489:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098712320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803533:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098712320:12345-0@lo:400:kworker.0 Request processed in 44us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483095.803539:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788483095.803566:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712832 00000100:00100000:1.0:1788483095.803570:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712832 00000100:00100000:1.0:1788483095.803592:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713344 00000100:00100000:1.0:1788483095.803595:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713344 00000100:00100000:1.0:1788483095.803607:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098712704 00000100:00100000:1.0:1788483095.803609:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712704 00000100:00100000:1.0:1788483095.803621:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713216 00000100:00100000:1.0:1788483095.803623:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713216 00000100:00100000:1.0:1788483095.803651:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788483095.803657:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098712832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803700:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098712832:12345-0@lo:400:kworker.0 Request processed in 42us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483095.803706:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788483095.803719:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788483095.803724:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098713344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803750:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098713344:12345-0@lo:400:kworker.0 Request processed in 26us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483095.803756:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788483095.803765:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788483095.803771:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098712704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803795:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098712704:12345-0@lo:400:kworker.0 Request processed in 24us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483095.803810:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788483095.803820:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788483095.803826:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098713216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803854:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098713216:12345-0@lo:400:kworker.0 Request processed in 28us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483095.803860:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788483095.803921:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098712704:0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.803933:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098713216:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.804205:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098712576 00000100:00100000:2.0:1788483095.804248:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788483095.804256:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098712576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.804295:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098712576:12345-0@lo:400:kworker.0 Request processed in 41us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483095.804302:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788483095.804449:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098712320:0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.804466:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788483095.804473:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788483095.804498:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69e03e0380, transno 4294967311 00000100:00100000:1.0:1788483095.804509:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098712832:0@lo:400:kworker.0 00000100:00100000:1.0:1788483095.804520:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788483095.804524:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1788483095.804542:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098713344:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.805707:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098711936:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.805750:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098712448:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.805762:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098712960:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.805775:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098712064:0@lo:400:kworker.0 00010000:00080000:2.0:1788483095.805791:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c59e4700 x1875360098712576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483095.805802:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098712576:0@lo:400:kworker.0 00010000:00080000:2.0:1788483095.805813:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb87480 x1875360098713088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483095.805820:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098713088:0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.805910:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098711808 00000100:00100000:2.0:1788483095.805918:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098711808 00000100:00100000:2.0:1788483095.805965:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788483095.805974:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098711808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483095.806075:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3620:x1875360098711808:12345-0@lo:400:kworker.0 Request processed in 87us (4078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483095.806083:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:2.0:1788483095.806152:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483095.806159:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483095.806163:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483095.806166:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483095.806870:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098711808:0@lo:400:kworker.0 00000100:00100000:3.0:1788483095.807042:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098712192:12345-0@lo:400:kworker.0 Request processed in 4116us (4811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483095.807055:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788483095.807404:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098713472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483095.807462:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483095.807516:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713472 00000100:00100000:0.0:1788483095.807522:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713472 00000100:00100000:0.0:1788483095.807562:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788483095.807570:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098713472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483095.807600:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788483095.807657:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098713472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483095.807664:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788483095.807716:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098713472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483095.807992:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098712192:0@lo:400:kworker.0 00000040:00080000:2.0:1788483096.058212:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483096.312870:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483096.312902:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098713600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483096.312995:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483096.313504:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713600 00000100:00100000:3.0:1788483096.313515:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713600 00000100:00100000:3.0:1788483096.313582:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788483096.313593:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098713600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483096.313619:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788483096.313701:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098713600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483096.313710:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788483096.313772:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098713600:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788483096.633173:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483096.633185:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483096.633285:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788483096.633292:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788483096.696218:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483097.336977:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483097.337076:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098713728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483097.337256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483097.338341:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483097.338357:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098713856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483097.338405:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483097.338449:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713856 00000100:00100000:1.0:1788483097.338457:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713856 00000100:00100000:1.0:1788483097.338508:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788483097.338517:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098713856:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483097.338773:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713728 00000100:00100000:2.0:1788483097.338778:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713728 00000100:00100000:2.0:1788483097.338808:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788483097.338814:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098713728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483097.338836:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788483097.338877:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098713728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483097.338884:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1788483097.338902:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483097.338963:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483097.338973:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098713984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483097.339000:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483097.339032:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098713984 00000100:00100000:2.0:1788483097.339036:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098713984 00000100:00100000:2.0:1788483097.339058:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788483097.339064:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098713984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483097.339078:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483097.339130:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098713984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483097.339137:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788483097.339149:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483097.339178:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098713984:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788483097.339336:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788483097.339379:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098713856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 863us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483097.339385:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788483097.339425:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098713728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483097.339812:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098713856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483097.442057:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483097.442243:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087127680 00000100:00100000:0.0:1788483097.442266:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087127680 00000100:00100000:0.0:1788483097.442362:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 255 00000100:00100000:0.0:1788483097.442375:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:12161:x1875360087127680:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788483097.442512:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:12161:x1875360087127680:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 Request processed in 139us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483097.442521:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 255 00000100:00080000:2.0:1788483097.442758:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483097.448791:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483097.448989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087127808 00000100:00100000:3.0:1788483097.449003:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087127808 00000100:00100000:3.0:1788483097.449079:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 256 00000100:00080000:2.0:1788483097.449090:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483097.449141:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:12161:x1875360087127808:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788483097.449254:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:12161:x1875360087127808:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 Request processed in 165us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483097.449263:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 256 00000100:00100000:1.0:1788483097.456993:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483097.457142:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128064 00000100:00100000:2.0:1788483097.457165:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128064 00000100:00100000:2.0:1788483097.457224:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:2.0:1788483097.457235:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:12161:x1875360087128064:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483097.457453:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:12161:x1875360087128064:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 219us (466us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788483097.457462:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:2.0:1788483097.618887:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483097.618999:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128192 00000100:00100000:1.0:1788483097.619009:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128192 00000100:00100000:1.0:1788483097.619089:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 257 00000100:00100000:1.0:1788483097.619139:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:12974:x1875360087128192:12345-192.168.206.54@tcp:101:lsof.0 00010000:00010000:1.0:1788483097.619158:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483097.619178:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e5fd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483097.619252:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b61d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483097.619264:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b61d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483097.619276:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b61d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483097.619476:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483097.619480:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483097.619505:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b61d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483097.619529:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5fd expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483097.619547:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b61d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5fd expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483097.619556:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:1.0:1788483097.619558:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483097.619562:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26a00, rc 0) 00000100:00080000:2.0:1788483097.619686:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483097.619723:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:12974:x1875360087128192:12345-192.168.206.54@tcp:101:lsof.0 Request processed in 624us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483097.619730:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 257 00010000:00010000:1.0:1788483097.720270:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483098.746791:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483098.768738:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483098.769043:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483098.769080:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483098.769196:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483098.769218:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483098.769287:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483098.769329:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483098.769348:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128448 00000100:00100000:3.0:1788483098.769357:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128448 00000100:00100000:2.0:1788483098.769397:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128960 00000100:00100000:2.0:1788483098.769403:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128960 00000100:00100000:3.0:1788483098.769410:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128576 00000100:00100000:3.0:1788483098.769415:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128576 00000100:00100000:3.0:1788483098.769434:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 364 00000100:00100000:3.0:1788483098.769443:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:2391:x1875360087128448:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483098.769516:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:2391:x1875360087128448:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 73us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483098.769538:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 364 00000100:00100000:3.0:1788483098.769555:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 365 00000100:00100000:3.0:1788483098.769562:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087128576:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483098.769587:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087128576:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483098.769592:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 365 00000100:00100000:3.0:1788483098.769751:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128320 00000100:00100000:3.0:1788483098.769765:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128320 00000100:00100000:3.0:1788483098.769792:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 399 00000100:00100000:3.0:1788483098.769798:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087128320:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483098.769826:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087128320:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483098.769833:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 399 00000100:00100000:1.0:1788483098.770144:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128704 00000100:00100000:1.0:1788483098.770149:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128704 00000100:00100000:1.0:1788483098.770201:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087128832 00000100:00100000:1.0:1788483098.770204:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087128832 00000100:00100000:1.0:1788483098.770227:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 164 00000100:00100000:1.0:1788483098.770235:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087128704:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483098.770268:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087128704:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 35us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483098.770274:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 164 00000100:00100000:1.0:1788483098.770436:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 165 00000100:00100000:1.0:1788483098.770450:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087128832:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483098.770482:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087128832:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 37us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483098.770558:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129088 00000100:00100000:2.0:1788483098.770563:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129088 00000100:00100000:0.0:1788483098.770573:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 366 00000100:00100000:0.0:1788483098.770585:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2391:x1875360087128960:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483098.770589:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 367 00000100:00100000:2.0:1788483098.770601:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087129088:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483098.770639:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2391:x1875360087128960:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 55us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483098.770640:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087129088:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 39us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483098.770654:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 366 00000100:00080000:0.0:1788483098.770723:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483098.770727:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483098.770729:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483098.771389:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 367 00000100:00100000:1.0:1788483098.774144:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 165 00010000:00010000:1.0:1788483099.772618:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788483099.898344:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788483099.898361:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788483099.898553:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788483099.898564:0:6526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788483099.900496:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483099.900526:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098714112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483099.900600:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483099.900938:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098714112 00000100:00100000:1.0:1788483099.900948:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098714112 00000100:00100000:1.0:1788483099.901013:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788483099.901023:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098714112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483099.901057:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788483099.901142:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098714112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483099.901149:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788483099.901195:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098714112:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788483100.792432:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483100.920525:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483100.920548:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098714240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483100.920610:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.921539:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098714496:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.921578:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.921598:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098715008:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.921617:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.921637:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098715520:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.921671:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.921688:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788483100.921694:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098714624:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.921716:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.921733:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098715136:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.921753:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.921765:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098715648:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.921784:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.921823:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098714624 00000100:00100000:3.0:1788483100.921843:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098714624 00000100:00100000:3.0:1788483100.921894:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788483100.921902:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098714624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.921954:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098714624:12345-0@lo:400:kworker.0 Request processed in 52us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483100.921961:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788483100.921985:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098714752:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922009:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.922020:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098715264:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922042:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.922056:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098715776:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922077:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.922119:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788483100.922127:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098714368:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922153:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.922170:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098714880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922187:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.922198:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098715392:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922213:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483100.922233:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715264 00000100:00100000:3.0:1788483100.922237:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715264 00000100:00100000:3.0:1788483100.922267:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715776 00000100:00100000:3.0:1788483100.922270:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715776 00000100:00100000:3.0:1788483100.922281:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715392 00000100:00100000:3.0:1788483100.922284:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715392 00000100:00100000:3.0:1788483100.922298:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788483100.922312:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098715264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922349:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098715264:12345-0@lo:400:kworker.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483100.922356:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788483100.922370:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788483100.922376:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098715776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922402:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098715776:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483100.922408:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788483100.922419:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788483100.922426:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098715392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922450:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098715392:12345-0@lo:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483100.922456:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788483100.922502:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098715392:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922513:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098715264:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922523:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098715776:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.922556:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098714624:0@lo:400:kworker.0 00000100:00100000:2.0:1788483100.923981:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098714496 00000100:00100000:2.0:1788483100.923992:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098714496 00000100:00100000:2.0:1788483100.924033:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715008 00000100:00100000:2.0:1788483100.924037:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715008 00000100:00100000:2.0:1788483100.924052:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715520 00000100:00100000:2.0:1788483100.924054:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715520 00000100:00100000:2.0:1788483100.924068:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715136 00000100:00100000:2.0:1788483100.924071:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715136 00000100:00100000:2.0:1788483100.924083:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715648 00000100:00100000:2.0:1788483100.924085:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715648 00000100:00100000:2.0:1788483100.924137:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098714752 00000100:00100000:2.0:1788483100.924141:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098714752 00000100:00100000:2.0:1788483100.924177:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788483100.924185:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098714496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483100.924247:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098714496:12345-0@lo:400:kworker.0 Request processed in 62us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483100.924253:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788483100.924407:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788483100.924413:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098715008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483100.924445:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098715008:12345-0@lo:400:kworker.0 Request processed in 33us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483100.924451:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788483100.924461:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788483100.924466:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098715520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483100.924492:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098715520:12345-0@lo:400:kworker.0 Request processed in 25us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483100.924497:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788483100.924507:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788483100.924513:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098715136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483100.924538:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098715136:12345-0@lo:400:kworker.0 Request processed in 26us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483100.924544:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788483100.924553:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788483100.924558:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098715648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483100.924582:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098715648:12345-0@lo:400:kworker.0 Request processed in 23us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483100.924587:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788483100.924605:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788483100.924610:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098714752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483100.924660:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098714752:12345-0@lo:400:kworker.0 Request processed in 50us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483100.924666:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788483100.924712:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098714752:0@lo:400:kworker.0 00000100:00100000:0.0:1788483100.924968:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098714240 00000100:00100000:0.0:1788483100.924973:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098714240 00000100:00100000:0.0:1788483100.925014:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788483100.925022:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098714240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483100.925043:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788483100.925087:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098714240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483100.925092:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788483100.925152:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098714368 00000100:00100000:0.0:1788483100.925157:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098714368 00000100:00100000:0.0:1788483100.925183:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788483100.925189:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098714368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483100.925223:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3619:x1875360098714368:12345-0@lo:400:kworker.0 Request processed in 35us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483100.925237:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788483100.925266:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098714880 00000100:00100000:0.0:1788483100.925270:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098714880 00000100:00100000:0.0:1788483100.925361:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788483100.925370:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098714880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483100.925404:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098714880:12345-0@lo:400:kworker.0 Request processed in 36us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483100.925409:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1788483100.925427:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483100.925431:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483100.925434:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483100.925436:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483100.925471:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098714240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483100.925500:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098714368:0@lo:400:kworker.0 00000100:00100000:0.0:1788483100.925510:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098714880:0@lo:400:kworker.0 00010000:00080000:3.0:1788483100.929459:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34ff480 x1875360098715136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483100.929479:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098715136:0@lo:400:kworker.0 00010000:00080000:3.0:1788483100.929492:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fdc00 x1875360098715648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483100.929519:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098715648:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.929535:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098714496:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.929545:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098715008:0@lo:400:kworker.0 00000100:00100000:3.0:1788483100.929556:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098715520:0@lo:400:kworker.0 00000001:02000400:1.0:1788483101.413699:0:15035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:51:39 (1788483099) 00000100:00100000:0.0:1788483101.432568:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098715904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483101.432665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483101.432819:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098715904 00000100:00100000:3.0:1788483101.432829:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098715904 00000100:00100000:3.0:1788483101.432896:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788483101.432908:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098715904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483101.432934:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788483101.432986:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098715904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483101.432994:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788483101.433155:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098715904:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788483101.820214:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483102.456354:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788483102.456385:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098716160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483102.456485:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483102.456557:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098716032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483102.456580:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483102.456611:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716160 00000100:00100000:1.0:1788483102.456620:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716160 00000100:00100000:1.0:1788483102.456692:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716032 00000100:00100000:2.0:1788483102.456709:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788483102.456711:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716032 00000100:00100000:2.0:1788483102.456723:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098716160:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483102.456731:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788483102.456736:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098716032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483102.456760:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788483102.456760:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483102.456811:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098716160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483102.456811:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098716032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483102.456819:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788483102.456857:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483102.456884:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483102.456894:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098716288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483102.456930:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483102.456931:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098716160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483102.456956:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098716032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483102.456986:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716288 00000100:00100000:0.0:1788483102.456990:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716288 00000100:00100000:0.0:1788483102.457048:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788483102.457055:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098716288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483102.457083:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788483102.457310:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788483102.457386:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098716288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 331us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483102.457393:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788483102.457423:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098716288:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788483102.841769:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483103.864319:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483103.890621:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483103.890687:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483103.890727:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483103.890764:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483103.890790:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483103.890811:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483103.890840:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483103.890876:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129472 00000100:00100000:0.0:1788483103.890887:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129472 00000100:00100000:0.0:1788483103.890948:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129984 00000100:00100000:0.0:1788483103.890952:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129984 00000100:00100000:0.0:1788483103.890966:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129344 00000100:00100000:0.0:1788483103.890968:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129344 00000100:00100000:0.0:1788483103.890981:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129856 00000100:00100000:0.0:1788483103.890984:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129856 00000100:00100000:0.0:1788483103.891001:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 374 00000100:00100000:0.0:1788483103.891012:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087129472:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483103.891150:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087129472:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 140us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483103.891159:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 374 00000100:00100000:0.0:1788483103.891179:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 375 00000100:00100000:0.0:1788483103.891185:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087129984:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483103.891229:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2391:x1875360087129984:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483103.891235:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 375 00000100:00100000:0.0:1788483103.891245:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 376 00000100:00100000:0.0:1788483103.891250:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:2391:x1875360087129344:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483103.891271:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:2391:x1875360087129344:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 21us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483103.891277:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 376 00000100:00100000:0.0:1788483103.891288:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 377 00000100:00100000:0.0:1788483103.891293:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2391:x1875360087129856:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483103.891316:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2391:x1875360087129856:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483103.891322:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 377 00000100:00080000:0.0:1788483103.891349:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483103.891354:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788483103.892004:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129216 00000100:00100000:2.0:1788483103.892015:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129216 00000100:00100000:3.0:1788483103.892040:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129728 00000100:00100000:3.0:1788483103.892047:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129728 00000100:00100000:2.0:1788483103.892074:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 401 00000100:00100000:2.0:1788483103.892087:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087129216:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483103.892122:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087129600 00000100:00100000:3.0:1788483103.892126:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087129600 00000100:00100000:3.0:1788483103.892157:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 169 00000100:00100000:3.0:1788483103.892166:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087129728:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483103.892176:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c71c064-eed6-492d-871f-d947c33908cf+13:2391:x1875360087129216:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 91us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483103.892185:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 401 00000100:00100000:3.0:1788483103.892203:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2391:x1875360087129728:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 38us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483103.892221:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 169 00000100:00100000:3.0:1788483103.892239:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 170 00000100:00100000:3.0:1788483103.892247:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087129600:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483103.892277:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2391:x1875360087129600:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 32us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483103.892283:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 170 00000100:00080000:3.0:1788483103.892308:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483103.892311:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788483104.663543:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483104.663669:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087130240 00000100:00100000:1.0:1788483104.663683:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087130240 00000100:00100000:1.0:1788483104.663756:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:1.0:1788483104.663768:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+18:13198:x1875360087130240:12345-192.168.206.54@tcp:35:umount.0 00000100:00100000:1.0:1788483104.664596:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:13198:x1875360087130240:12345-192.168.206.54@tcp:35:umount.0 Request processed in 526us (763us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788483104.664608:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:2.0:1788483104.679395:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483104.679565:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087130496 00000100:00100000:1.0:1788483104.679578:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087130496 00000100:00100000:1.0:1788483104.679662:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:1.0:1788483104.679675:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+19:13198:x1875360087130496:12345-192.168.206.54@tcp:35:umount.0 00000100:00100000:1.0:1788483104.680584:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:13198:x1875360087130496:12345-192.168.206.54@tcp:35:umount.0 Request processed in 907us (1198us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788483104.680598:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:3.0:1788483104.689089:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483104.690797:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087130752 00000100:00100000:1.0:1788483104.690820:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087130752 00000100:00100000:1.0:1788483104.691031:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:1.0:1788483104.691045:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f4622850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+20:13198:x1875360087130752:12345-192.168.206.54@tcp:35:umount.0 00000100:00100000:1.0:1788483104.691418:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f4622850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:13198:x1875360087130752:12345-192.168.206.54@tcp:35:umount.0 Request processed in 375us (2342us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788483104.691427:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:3.0:1788483104.698213:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483104.707496:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087131008 00000100:00100000:0.0:1788483104.707515:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087131008 00000100:00100000:0.0:1788483104.707599:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:0.0:1788483104.707611:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:13198:x1875360087131008:12345-192.168.206.54@tcp:35:umount.0 00000100:00100000:0.0:1788483104.708077:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:13198:x1875360087131008:12345-192.168.206.54@tcp:35:umount.0 Request processed in 465us (9878us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788483104.708086:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:2.0:1788483104.713275:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483104.713323:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483104.713360:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483104.713453:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087131136 00000100:00100000:1.0:1788483104.713467:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087131136 00000100:00100000:0.0:1788483104.713494:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087131392 00000100:00100000:0.0:1788483104.713521:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087131392 00000100:00100000:1.0:1788483104.713548:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087131264 00000100:00100000:1.0:1788483104.713553:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087131264 00000100:00100000:0.0:1788483104.713558:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:0.0:1788483104.713572:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c71c064-eed6-492d-871f-d947c33908cf+15:2390:x1875360087131136:12345-192.168.206.54@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788483104.713582:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00010000:00010000:0.0:1788483104.713592:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788483104.713593:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+15:2390:x1875360087131392:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483104.713606:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483104.713638:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0c00/0x1d7ea3d89ea1a5d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e150 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.713640:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76200/0x1d7ea3d89ea1a80f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e229 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.713668:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483104.713668:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483104.714136:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+13:2390:x1875360087131392:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 542us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483104.714146:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788483104.714170:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:3.0:1788483104.714178:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+12:2390:x1875360087131264:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483104.714188:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483104.714200:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3200/0x1d7ea3d89ea1a537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e111 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483104.714211:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483104.714232:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c71c064-eed6-492d-871f-d947c33908cf+11:2390:x1875360087131264:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 55us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483104.714239:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:0.0:1788483104.714382:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c71c064-eed6-492d-871f-d947c33908cf+10:2390:x1875360087131136:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 813us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483104.714390:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:3.0:1788483104.715971:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483104.716180:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087131776 00000100:00100000:0.0:1788483104.716194:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087131776 00000100:00100000:0.0:1788483104.716264:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 80 00000100:00100000:0.0:1788483104.716276:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+7:2389:x1875360087131776:12345-192.168.206.54@tcp:9:umount.0 00000020:00000080:0.0:1788483104.716323:0:8412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ab88 00000020:00010000:0.0:1788483104.716336:0:8412:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a69c626e000: total 0 00000100:00080000:0.0:1788483104.716343:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9a69c626d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483104.717055:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788483104.717307:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2389:x1875360087131776:12345-192.168.206.54@tcp:9:umount.0 Request processed in 1028us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483104.717318:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 80 00000020:00010000:1.0:1788483104.718644:0:6481:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a69c626e000: total 0 00010000:00010000:1.0:1788483104.718738:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a69c626e000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788483104.718814:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5554eda/0x1d7ea3d89ea1b60f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5f6 expref: 4 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.718860:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f280c7c/0x1d7ea3d89ea1af40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e413 expref: 3 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.718879:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a69c626e000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788483104.718894:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483104.718907:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483104.718909:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483104.721035:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483104.721562:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087131904 00000100:00100000:3.0:1788483104.721595:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087131904 00000100:00100000:3.0:1788483104.721682:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 81 00000100:00100000:3.0:1788483104.721694:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2389:x1875360087131904:12345-192.168.206.54@tcp:9:umount.0 00000020:00000080:3.0:1788483104.721731:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a912 00000100:00080000:3.0:1788483104.721743:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9a69c7878800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788483104.721800:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788483104.722028:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+2:2389:x1875360087131904:12345-192.168.206.54@tcp:9:umount.0 Request processed in 336us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483104.722037:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 81 00010000:00010000:1.0:1788483104.722196:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483104.740036:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483104.740487:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087132928 00000100:00100000:0.0:1788483104.740501:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087132928 00000100:00100000:0.0:1788483104.740597:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 258 00000100:00100000:0.0:1788483104.740609:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+22:2389:x1875360087132928:12345-192.168.206.54@tcp:39:umount.0 00000020:00000080:0.0:1788483104.740666:0:6494:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a545 00000020:00010000:0.0:1788483104.740697:0:6494:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a68c33a1800: total 0 00000100:00080000:0.0:1788483104.740703:0:6494:0:(import.c:65:import_set_state_nolock()) ffff9a69ece23800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483104.740745:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788483104.741030:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d93ec387-f41f-455a-afdd-b6a72a2f59de+21:2389:x1875360087132928:12345-192.168.206.54@tcp:39:umount.0 Request processed in 422us (1008us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788483104.741040:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 258 00000020:00010000:1.0:1788483104.741699:0:7446:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a68c33a1800: total 0 00010000:00010000:1.0:1788483104.741776:0:7446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a68c33a1800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788483104.741821:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483104.741826:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788483104.741838:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1afc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e436 expref: 20 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.741862:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483104.741865:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483104.741869:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9600/0x1d7ea3d89ea1ae21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3c6 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.741883:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69df0bf000) 00010000:00010000:1.0:1788483104.741886:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483104.741889:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1000/0x1d7ea3d89ea1a871 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e237 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.741923:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483104.741927:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483104.741931:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1400/0x1d7ea3d89ea1b5d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5e1 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.741944:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483104.741946:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788483104.741950:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1b5fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5ef expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.741965:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68c1c53900) 00010000:00010000:1.0:1788483104.741968:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788483104.741985:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27400/0x1d7ea3d89ea1b2b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e50f expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742005:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:1.0:1788483104.742008:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483104.742013:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26800/0x1d7ea3d89ea1afa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e42f expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742025:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:1.0:1788483104.742028:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788483104.742032:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1a8e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e253 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742042:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483104.742045:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483104.742048:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1af01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e3fe expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742060:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a69c591a800) 00010000:00010000:1.0:1788483104.742062:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483104.742066:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1b4f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5a9 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742082:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a69c32fa100) 00010000:00010000:1.0:1788483104.742084:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788483104.742087:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c1529c00/0x1d7ea3d89ea1af2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e40c expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742165:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68c3183900) 00010000:00010000:1.0:1788483104.742605:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788483104.742612:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1abe3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e32c expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742646:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68c1c56800) 00010000:00010000:1.0:1788483104.742648:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483104.742653:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1a88d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e23e expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.742668:0:7446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a68c33a1800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788483104.742702:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483104.742705:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483104.742707:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483104.751712:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483104.752117:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087133056 00000100:00100000:0.0:1788483104.752131:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087133056 00000100:00100000:0.0:1788483104.752217:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 259 00000100:00100000:0.0:1788483104.752230:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+5:2389:x1875360087133056:12345-192.168.206.54@tcp:39:umount.0 00000020:00000080:0.0:1788483104.752274:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a54c 00000100:00080000:0.0:1788483104.752305:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483104.752336:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788483104.756635:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483104.760503:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d93ec387-f41f-455a-afdd-b6a72a2f59de+3:2389:x1875360087133056:12345-192.168.206.54@tcp:39:umount.0 Request processed in 8258us (8789us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788483104.760524:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 259 00010000:00010000:1.0:1788483104.888668:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483105.020156:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483105.020190:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098716416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483105.020364:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483105.021124:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716416 00000100:00100000:3.0:1788483105.021137:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716416 00000100:00100000:3.0:1788483105.021212:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788483105.021222:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098716416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483105.021270:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788483105.021465:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098716416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 244us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483105.021474:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788483105.022036:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098716416:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483105.913787:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483105.975254:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483105.975399:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483105.979936:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087133184 00000100:00100000:0.0:1788483105.979959:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087133184 00000100:00100000:3.0:1788483105.980385:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483105.982034:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483105.983969:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087133312 00000100:00100000:0.0:1788483105.983994:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087133312 00000100:00100000:0.0:1788483105.984087:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087133440 00000100:00100000:0.0:1788483105.984090:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087133440 00000100:00100000:0.0:1788483105.984139:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:0.0:1788483105.984151:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+12:2391:x1875360087133184:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483105.984172:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483105.984198:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77400/0x1d7ea3d89ea1a648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e165 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483105.984244:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483105.984339:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+11:2391:x1875360087133184:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 190us (9108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483105.984348:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:0.0:1788483105.984375:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:0.0:1788483105.984382:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+10:2391:x1875360087133312:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483105.984392:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483105.984402:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1a64f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e196 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483105.984412:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483105.984431:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+9:2391:x1875360087133312:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 49us (9032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483105.984437:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:0.0:1788483105.984491:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:0.0:1788483105.984498:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+8:2390:x1875360087133440:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483105.984506:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483105.984515:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1a808 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e222 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483105.984524:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483105.984542:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c71c064-eed6-492d-871f-d947c33908cf+7:2390:x1875360087133440:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 45us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483105.984548:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:0.0:1788483105.984581:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087133696 00000100:00100000:0.0:1788483105.984592:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087133696 00000100:00100000:0.0:1788483105.984661:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 260 00000100:00100000:0.0:1788483105.984669:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+6:2389:x1875360087133696:12345-192.168.206.54@tcp:39:umount.0 00000100:00080000:1.0:1788483105.985131:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788483105.988337:0:6494:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a65d 00000020:00010000:0.0:1788483105.988369:0:6494:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a69efd95800: total 0 00000100:00080000:0.0:1788483105.988377:0:6494:0:(import.c:65:import_set_state_nolock()) ffff9a69efd92800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483105.988468:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:1.0:1788483105.989092:0:6481:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a69efd95800: total 0 00010000:00010000:1.0:1788483105.989125:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483105.989259:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a69efd95800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788483105.989304:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69df303300) 00010000:00010000:1.0:1788483105.989309:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483105.989322:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1b61d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e5fd expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483105.989350:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a69efd95800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788483105.989362:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483105.989364:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483105.989366:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483105.990481:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+3:2389:x1875360087133696:12345-192.168.206.54@tcp:39:umount.0 Request processed in 5802us (8448us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788483105.990495:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 260 00000100:00100000:3.0:1788483106.003723:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483106.010899:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087133824 00000100:00100000:1.0:1788483106.010975:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087133824 00000100:00100000:1.0:1788483106.011164:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 261 00000100:00080000:3.0:1788483106.011170:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483106.011367:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+5:2389:x1875360087133824:12345-192.168.206.54@tcp:39:umount.0 00000020:00000080:1.0:1788483106.011434:0:6495:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a664 00000100:00080000:1.0:1788483106.011447:0:6495:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788483106.011485:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1788483106.011573:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483106.013164:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2516ebfb-bd7b-4ba4-90be-ef22e18c99ce+3:2389:x1875360087133824:12345-192.168.206.54@tcp:39:umount.0 Request processed in 1974us (9444us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788483106.013185:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 261 00000100:00100000:1.0:1788483106.040410:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483106.040436:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098716544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483106.040521:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483106.041667:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098716800:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.041723:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.041764:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098717056:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.041789:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098717312:0@lo:400:kworker.0 00000100:00100000:1.0:1788483106.041882:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098716672:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.042123:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.047179:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483106.049157:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716544 00000100:00100000:0.0:1788483106.049690:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716544 00000100:00080000:3.0:1788483106.049938:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483106.049985:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098717824:0@lo:400:kworker.0 00000100:00100000:2.0:1788483106.049999:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098717568:0@lo:400:kworker.0 00000100:00100000:2.0:1788483106.050086:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483106.050132:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.050183:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098718080:0@lo:400:kworker.0 00000100:00100000:1.0:1788483106.050197:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098717184:0@lo:400:kworker.0 00000100:00100000:2.0:1788483106.050222:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483106.050246:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.050275:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788483106.050286:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098717696:0@lo:400:kworker.0 00000100:00100000:2.0:1788483106.050289:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098716928:0@lo:400:kworker.0 00000100:00100000:1.0:1788483106.050341:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.050350:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.050387:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098717440:0@lo:400:kworker.0 00000100:00100000:1.0:1788483106.050400:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716672 00000100:00100000:1.0:1788483106.050408:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716672 00000100:00100000:2.0:1788483106.050420:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.050450:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098717952:0@lo:400:kworker.0 00000100:00100000:2.0:1788483106.050475:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483106.050511:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717184 00000100:00100000:2.0:1788483106.050518:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717184 00000100:00100000:2.0:1788483106.050629:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716928 00000100:00100000:2.0:1788483106.050633:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716928 00000100:00100000:2.0:1788483106.050655:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788483106.050664:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098717184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.050853:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788483106.050867:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098716544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483106.051064:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483106.051142:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717568 00000100:00100000:3.0:1788483106.051148:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717568 00000100:00100000:3.0:1788483106.051182:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718080 00000100:00100000:3.0:1788483106.051185:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718080 00000100:00100000:3.0:1788483106.051199:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717696 00000100:00100000:3.0:1788483106.051202:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717696 00000100:00100000:3.0:1788483106.051216:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788483106.051222:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098717568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.051277:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098717568:12345-0@lo:400:kworker.0 Request processed in 54us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483106.051284:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788483106.051300:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788483106.051306:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098718080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.051331:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098718080:12345-0@lo:400:kworker.0 Request processed in 26us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483106.051337:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788483106.051346:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788483106.051351:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098717696:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788483106.051733:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788483106.052762:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098716544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1895us (12237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.052771:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788483106.052816:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098716800 00000100:00100000:0.0:1788483106.052822:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098716800 00000100:00100000:0.0:1788483106.052846:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717312 00000100:00100000:0.0:1788483106.052848:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717312 00000100:00100000:0.0:1788483106.052863:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717056 00000100:00100000:0.0:1788483106.052866:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717056 00000100:00100000:0.0:1788483106.052876:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717440 00000100:00100000:0.0:1788483106.052878:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717440 00000100:00100000:0.0:1788483106.052892:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717952 00000100:00100000:0.0:1788483106.052895:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717952 00000100:00100000:0.0:1788483106.052907:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098717824 00000100:00100000:0.0:1788483106.052923:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098717824 00000100:00100000:0.0:1788483106.052942:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788483106.052949:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098716800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.053000:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098716800:12345-0@lo:400:kworker.0 Request processed in 50us (11279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.053006:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788483106.053020:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788483106.053027:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098717312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.053053:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098717312:12345-0@lo:400:kworker.0 Request processed in 28us (10931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.053059:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788483106.053072:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788483106.053077:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098717056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.053120:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098717056:12345-0@lo:400:kworker.0 Request processed in 43us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.053126:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788483106.053139:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788483106.053145:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098717440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.053173:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098717440:12345-0@lo:400:kworker.0 Request processed in 28us (2754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.053178:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788483106.053189:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788483106.053195:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098717952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.053221:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098717952:12345-0@lo:400:kworker.0 Request processed in 26us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.053236:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788483106.053249:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788483106.053256:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098717824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.053287:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098717824:12345-0@lo:400:kworker.0 Request processed in 32us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.053292:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788483106.053489:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098717184:12345-0@lo:400:kworker.0 Request processed in 2824us (3244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483106.053508:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788483106.053525:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788483106.053532:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098716928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483106.053567:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098716928:12345-0@lo:400:kworker.0 Request processed in 35us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483106.053573:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788483106.053711:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098717696:12345-0@lo:400:kworker.0 Request processed in 2357us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483106.053719:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1788483106.053757:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483106.053767:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483106.053769:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483106.053772:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483106.053808:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098716800:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.053821:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098717312:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.053830:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098717824:0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.054582:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098716544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483106.055904:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098716928:0@lo:400:kworker.0 00010000:00080000:3.0:1788483106.055923:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fed80 x1875360098717440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483106.055934:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098717440:0@lo:400:kworker.0 00010000:00080000:3.0:1788483106.055945:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34ff100 x1875360098717952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483106.055954:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098717952:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.055964:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098717056:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.055974:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098717568:0@lo:400:kworker.0 00000100:00100000:3.0:1788483106.055985:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098718080:0@lo:400:kworker.0 00000100:00100000:1.0:1788483106.058291:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788483106.058311:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098716672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483106.058396:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098716672:12345-0@lo:400:kworker.0 Request processed in 92us (8269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483106.058404:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788483106.059837:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098716672:0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.059857:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098717184:0@lo:400:kworker.0 00000100:00100000:0.0:1788483106.059870:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098717696:0@lo:400:kworker.0 00000100:00100000:2.0:1788483106.073570:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483106.074004:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134080 00000100:00100000:0.0:1788483106.074014:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134080 00000100:00100000:0.0:1788483106.074071:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 403 00000100:00100000:0.0:1788483106.074082:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+7:2389:x1875360087134080:12345-192.168.206.54@tcp:251:umount.0 00000020:00000080:0.0:1788483106.074168:0:6486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a522 00000020:00010000:0.0:1788483106.074177:0:6486:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a68c36b0800: total 0 00000100:00080000:0.0:1788483106.074182:0:6486:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b3800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788483106.074249:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c71c064-eed6-492d-871f-d947c33908cf+3:2389:x1875360087134080:12345-192.168.206.54@tcp:251:umount.0 Request processed in 168us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483106.074258:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 403 00000020:00010000:1.0:1788483106.074991:0:7446:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a68c36b0800: total 0 00010000:00010000:1.0:1788483106.075056:0:7446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a68c36b0800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788483106.075136:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1a5fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e157 expref: 2 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483106.075152:0:7446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a68c36b0800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788483106.075166:0:7446:0:(genops.c:885:class_export_put()) final put ffff9a68c36b0800/1c71c064-eed6-492d-871f-d947c33908cf 00010000:00010000:1.0:1788483106.075229:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483106.075232:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483106.075234:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788483106.078671:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b0800/1c71c064-eed6-492d-871f-d947c33908cf for MGS 00000020:00000080:3.0:1788483106.083200:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c36b3800 for MGS 00000040:00080000:2.0:1788483106.297444:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483106.552522:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483106.552544:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098718208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483106.552627:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483106.552743:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718208 00000100:00100000:3.0:1788483106.552751:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718208 00000100:00100000:3.0:1788483106.552812:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788483106.552821:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098718208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483106.552841:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788483106.552903:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098718208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483106.552911:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788483106.553800:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098718208:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788483106.872982:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483106.872990:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483106.873080:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788483106.873088:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788483106.936202:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483107.576291:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098718336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483107.576362:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483107.576881:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718336 00000100:00100000:2.0:1788483107.576889:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718336 00000100:00100000:2.0:1788483107.576934:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788483107.576944:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098718336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483107.576975:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788483107.577031:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098718336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483107.577038:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788483107.577059:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483107.577068:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098718464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483107.577123:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483107.577176:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098718336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483107.577201:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718464 00000100:00100000:2.0:1788483107.577205:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718464 00000100:00100000:2.0:1788483107.577230:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788483107.577237:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098718464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483107.577263:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483107.577298:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098718464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483107.577305:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788483107.577346:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098718464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483107.577707:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098718592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483107.577739:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483107.579396:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718592 00000100:00100000:2.0:1788483107.579407:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718592 00000100:00100000:2.0:1788483107.579449:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788483107.579457:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098718592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483107.579479:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483107.590821:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098718592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11355us (13072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483107.590835:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788483107.599514:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098718592:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483107.967642:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788483108.034941:0:15232:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788483108.061365:0:15232:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788483108.061420:0:15232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.061433:0:15232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.061440:0:15232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.061447:0:15232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.062190:0:15232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788483108.062199:0:15232:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788483108.062230:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483108.062235:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788483108.062241:0:15232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788483108.062266:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a69d0f48800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788483108.062707:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098718720:0@lo:39:umount.0 00000100:00100000:2.0:1788483108.062785:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483108.062961:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718720 00000100:00100000:0.0:1788483108.062968:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718720 00000100:00100000:0.0:1788483108.063025:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788483108.063034:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875360098718720:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788483108.063059:0:6494:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a139 00000100:00080000:0.0:1788483108.063068:0:6494:0:(import.c:65:import_set_state_nolock()) ffff9a69d1344800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788483108.068023:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483108.068039:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.068051:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0a00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483108.068055:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.068065:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483108.068072:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483108.068077:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483108.068080:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788483108.068083:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788483108.068149:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.068169:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483108.068201:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.068208:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0a00/0x1d7ea3d89ea1a5ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.068224:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483108.068226:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483108.068228:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483108.069399:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098718848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483108.069465:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.069772:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718848 00000100:00100000:1.0:1788483108.069781:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718848 00000100:00100000:1.0:1788483108.070010:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788483108.070021:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+24:3621:x1875360098718848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483108.070035:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483108.070055:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76a00/0x1d7ea3d89ea1a5d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ca expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.070070:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483108.070138:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:3621:x1875360098718848:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483108.070145:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788483108.070158:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098718848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483108.070798:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3618:x1875360098718720:12345-0@lo:39:umount.0 Request processed in 7762us (8009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483108.070808:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1788483108.070818:0:6494:0:(genops.c:885:class_export_put()) final put ffff9a69d1346800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788483108.070917:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d0f48800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788483108.070935:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098718720:0@lo:39:umount.0 00000020:00000080:3.0:1788483108.070991:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d1346800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788483108.071044:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69d1344800 for lustre-MDT0000 00000100:00080000:0.0:1788483108.071508:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483108.071521:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788483108.071526:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788483108.072869:0:15232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.072885:0:15232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.072893:0:15232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.072899:0:15232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.075328:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483108.075341:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.075353:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483108.075357:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.075381:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483108.075389:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483108.075396:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483108.075399:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788483108.075435:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.075440:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788483108.075499:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098718976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483108.075566:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788483108.075694:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.075704:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483108.075706:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483108.075708:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483108.075915:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098718976 00000100:00100000:2.0:1788483108.075923:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098718976 00000100:00100000:2.0:1788483108.075974:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788483108.075983:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:3622:x1875360098718976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483108.076004:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483108.076017:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1a5e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5df expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.076032:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483108.076266:0:15232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788483108.076274:0:15232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0031400/0x1d7ea3d89ea1a5df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5e6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076291:0:15232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076298:0:15232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076305:0:15232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076311:0:15232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076336:0:15232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483108.076342:0:15232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076349:0:15232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076354:0:15232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076360:0:15232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076369:0:15232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788483108.076373:0:15232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076379:0:15232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076384:0:15232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076390:0:15232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.076396:0:15232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788483108.076400:0:15232:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788483108.076409:0:15232:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788483108.076453:0:15232:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788483108.076457:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788483108.076463:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483108.076469:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788483108.076475:0:15232:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a68c33a1000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483108.076481:0:15232:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a69f7364800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483108.076485:0:15232:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a69ece14000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483108.076489:0:15232:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a69df329800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788483108.076495:0:15232:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a69efd95800 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 192.168.206.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483108.076500:0:15232:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a68c33a1800 d93ec387-f41f-455a-afdd-b6a72a2f59de 192.168.206.54@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1788483108.076505:0:15232:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a69df0b0000) has exports, disconnecting them 00000020:00080000:0.0:1788483108.076508:0:15232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a68c33a1000), last request at 1788483106 00000020:00000080:0.0:1788483108.076527:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a449 00000100:00080000:0.0:1788483108.076543:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a0800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788483108.076741:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788483108.076747:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076755:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c0031800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483108.076758:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076765:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483108.076772:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483108.076785:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483108.076788:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788483108.076790:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788483108.076813:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076819:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483108.076840:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076847:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c0031800/0x1d7ea3d89ea1a4dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a4e3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076858:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483108.076861:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076867:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483108.076869:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076877:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483108.076883:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483108.076887:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788483108.076890:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788483108.076891:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788483108.076912:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076918:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483108.076924:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076930:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76800/0x1d7ea3d89ea1a840 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a847 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076938:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483108.076942:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076947:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483108.076950:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076956:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483108.076962:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483108.076967:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483108.076969:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788483108.076971:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788483108.076982:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.076988:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1788483108.077199:0:15232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c33a1000): rc 0 00000020:00000080:0.0:1788483108.077201:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a68c33a1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788483108.077215:0:15232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a69f7364800), last request at 1788483106 00000020:00000080:0.0:1788483108.077220:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a323 00000100:00080000:0.0:1788483108.077227:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a69f7363800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788483108.077235:0:15232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69f7364800): rc 0 00000020:00000080:0.0:1788483108.077237:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69f7364800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788483108.077241:0:15232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a69ece14000), last request at 1788482864 00000020:00000080:0.0:1788483108.077243:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a220 00000100:00080000:0.0:1788483108.077246:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a69ece15000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788483108.077253:0:15232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69ece14000): rc 0 00000020:00000080:0.0:1788483108.077254:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69ece14000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788483108.077265:0:15232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a69df329800), last request at 1788482864 00000020:00000080:0.0:1788483108.077269:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a1e1 00000100:00080000:0.0:1788483108.077272:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a69ece20000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483108.077279:0:15232:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1788483108.077343:0:15232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69df329800): rc 0 00000004:00000080:0.0:1788483108.077350:0:15232:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb5384150bae0 00000100:00080000:0.0:1788483108.077366:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788483108.077369:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788483108.078958:0:15232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788483108.078985:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a69e00f5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788483108.079163:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483108.079169:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483108.080377:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:3622:x1875360098718976:12345-0@lo:103:ldlm_bl.0 Request processed in 4389us (4804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.080390:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788483108.080426:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098719488:0@lo:39:umount.0 00000100:00100000:2.0:1788483108.080483:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788483108.080522:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33a1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788483108.081019:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f7364800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788483108.081048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece14000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788483108.081070:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c33a0800 for lustre-MDT0000 00000020:00000080:2.0:1788483108.081077:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69f7363800 for lustre-MDT0000 00000020:00000080:2.0:1788483108.081080:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece15000 for lustre-MDT0000 00000100:00100000:2.0:1788483108.081185:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098719488 00000100:00100000:2.0:1788483108.081192:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098719488 00000100:00100000:2.0:1788483108.081235:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788483108.081244:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875360098719488:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788483108.081269:0:6499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a27b 00000100:00080000:2.0:1788483108.081276:0:6499:0:(import.c:65:import_set_state_nolock()) ffff9a69ece98800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483108.081298:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788483108.081429:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3618:x1875360098719488:12345-0@lo:39:umount.0 Request processed in 185us (945us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788483108.081437:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:2.0:1788483108.081476:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e00f5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788483108.081495:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098719488:0@lo:39:umount.0 00010000:00010000:2.0:1788483108.081537:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483108.081568:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098719232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483108.081845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483108.081880:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483108.081887:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098719104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483108.081910:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483108.081937:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098719232 00000100:00100000:2.0:1788483108.081941:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098719232 00000100:00100000:2.0:1788483108.081973:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098719104 00000100:00100000:2.0:1788483108.081976:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098719104 00000100:00100000:2.0:1788483108.081992:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788483108.081999:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+23:3620:x1875360098719232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483108.082009:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483108.082028:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76600/0x1d7ea3d89ea1a847 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a840 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.082042:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483108.082070:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+22:3620:x1875360098719232:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.082076:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788483108.082088:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788483108.082120:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+21:3620:x1875360098719104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483108.082129:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483108.082137:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1a4e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a4dc expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.082158:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483108.082184:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3620:x1875360098719104:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.082189:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788483108.082219:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098719104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483108.082226:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098719232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483108.082334:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.082350:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6800/0x1d7ea3d89ea1a098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a09f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.082360:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483108.082362:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483108.082364:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483108.082380:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098719360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483108.082409:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483108.082472:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098719360 00000100:00100000:2.0:1788483108.082476:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098719360 00000100:00100000:2.0:1788483108.082507:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788483108.082677:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788483108.082682:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788483108.082694:0:15232:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788483108.082955:0:15232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788483108.082975:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a69efd40800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788483108.082990:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788483108.082993:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1788483108.083003:0:15232:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788483108.083068:0:15232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788483108.083081:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788483108.083132:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a69df0b0000) has no exports 00000100:00100000:2.0:1788483108.083498:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+20:3621:x1875360098719360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483108.083647:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483108.083666:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6a021c7c00/0x1d7ea3d89ea1a09f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a098 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.083680:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483108.083994:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:3621:x1875360098719360:12345-0@lo:103:ldlm_bl.0 Request processed in 1479us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.084003:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788483108.084040:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098719616:0@lo:9:umount.0 00000100:00100000:2.0:1788483108.084076:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483108.084124:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098719744:0@lo:9:umount.0 00000100:00100000:2.0:1788483108.084147:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483108.084191:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098719616 00000100:00100000:2.0:1788483108.084197:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098719616 00000100:00100000:2.0:1788483108.084236:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098719744 00000100:00100000:2.0:1788483108.084249:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098719744 00000100:00100000:2.0:1788483108.084274:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788483108.084282:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875360098719616:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788483108.084302:0:8551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a3cb 00000100:00080000:2.0:1788483108.084310:0:8551:0:(import.c:65:import_set_state_nolock()) ffff9a69efd47800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483108.084349:0:8551:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788483108.084469:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3618:x1875360098719616:12345-0@lo:9:umount.0 Request processed in 187us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.084475:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788483108.084488:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788483108.084495:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875360098719744:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788483108.084507:0:8551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a50d 00000100:00080000:2.0:1788483108.084527:0:8551:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483108.084550:0:8551:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788483108.084714:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098719360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483108.084994:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3618:x1875360098719744:12345-0@lo:9:umount.0 Request processed in 498us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.085001:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788483108.085030:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd40800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788483108.085051:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788483108.085054:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788483108.085057:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098719616:0@lo:9:umount.0 00000100:00080000:2.0:1788483108.085069:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788483108.085078:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788483108.085079:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788483108.085082:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098719744:0@lo:9:umount.0 00010000:00010000:2.0:1788483108.085129:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483108.085134:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788483108.085156:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483108.085168:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483108.085393:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098718976:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788483108.104872:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a69df0b0000) has no exports 00000020:00000080:1.0:1788483108.160062:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a0f3 00000020:00000080:1.0:1788483108.160077:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69ecc4a800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788483108.160130:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788483108.160182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ecc4a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788483108.160183:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483108.160193:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788483108.160198:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a69f45e99b8) has no exports 00000020:00000080:0.0:1788483108.175218:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a0ec 00000020:00000080:0.0:1788483108.175234:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c5931000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788483108.175382:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5931000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788483108.175543:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483108.175553:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788483108.175557:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c5ff3800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788483108.175560:0:15232:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5ff3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788483108.175565:0:15232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788483108.984357:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483110.008282:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483110.136329:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483110.136352:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098719872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483110.136421:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483110.136643:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098719872 00000100:00100000:2.0:1788483110.136651:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098719872 00000100:00100000:2.0:1788483110.136692:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788483110.136700:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875360098719872:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788483110.136707:0:6498:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788483110.136749:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875360098719872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (327us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788483110.136756:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:02020000:3.0:1788483110.136839:0:3621:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788483110.150265:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788483110.150274:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788483110.150279:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788483110.168390:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483110.168418:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 156 00000100:00080000:3.0:1788483110.168427:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a69c5ff0000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483110.168499:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c34fdc00 x1875360098720000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483110.171642:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098720000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788483110.171745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483110.171968:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720000 00000100:00100000:1.0:1788483110.171978:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720000 00000100:00100000:1.0:1788483110.172026:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788483110.172034:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098720000:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788483110.172052:0:7805:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788483110.180377:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098720000:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 8335us (8626us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483110.180390:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:0.0:1788483110.183144:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483110.183156:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483110.183161:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098720000:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1788483110.662146:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788483110.662155:0:6472:0:(genops.c:885:class_export_put()) final put ffff9a69df329800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788483110.662176:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000001:00080000:0.0:1788483110.662184:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788483110.662188:0:6472:0:(genops.c:885:class_export_put()) final put ffff9a69efd95800/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000001:00100000:0.0:1788483110.662192:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000001:00080000:0.0:1788483110.662196:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788483110.662205:0:6472:0:(genops.c:885:class_export_put()) final put ffff9a68c33a1800/d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:3.0:1788483110.663967:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69df329800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788483110.664028:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd95800/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce for lustre-MDT0000 00000020:00000080:3.0:1788483110.664052:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33a1800/d93ec387-f41f-455a-afdd-b6a72a2f59de for lustre-MDT0000 00000020:00000080:3.0:1788483110.664079:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece20000 for lustre-MDT0000 00000020:00000080:3.0:1788483110.664083:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd92800 for lustre-MDT0000 00000020:00000080:3.0:1788483110.664086:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece23800 for lustre-MDT0000 00000001:00100000:2.0:1788483110.664556:0:7424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788483110.664566:0:7424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788483110.664570:0:7424:0:(genops.c:885:class_export_put()) final put ffff9a69ece9a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788483110.664601:0:7424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000001:00080000:2.0:1788483110.664609:0:7424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788483110.664611:0:7424:0:(genops.c:885:class_export_put()) final put ffff9a69efd97800/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce 00000001:00100000:2.0:1788483110.664616:0:7424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000001:00080000:2.0:1788483110.664621:0:7424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788483110.664623:0:7424:0:(genops.c:885:class_export_put()) final put ffff9a68c33c3000/d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:0.0:1788483110.664957:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece9a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788483110.665000:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd97800/2516ebfb-bd7b-4ba4-90be-ef22e18c99ce for lustre-MDT0001 00000001:00100000:1.0:1788483110.665011:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788483110.665014:0:8405:0:(genops.c:885:class_export_put()) final put ffff9a69efd45800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788483110.665020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33c3000/d93ec387-f41f-455a-afdd-b6a72a2f59de for lustre-MDT0001 00000001:00100000:1.0:1788483110.665022:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:1.0:1788483110.665023:0:8405:0:(genops.c:885:class_export_put()) final put ffff9a69c787a000/d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:0.0:1788483110.665041:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece98800 for lustre-MDT0001 00000020:00000080:0.0:1788483110.665045:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd93800 for lustre-MDT0001 00000020:00000080:0.0:1788483110.665048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd45800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788483110.665065:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c33c6800 for lustre-MDT0001 00000020:00000080:0.0:1788483110.665070:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c787a000/d93ec387-f41f-455a-afdd-b6a72a2f59de for lustre-OST0000 00000020:00000080:0.0:1788483110.665084:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd47800 for lustre-OST0000 00000020:00000080:0.0:1788483110.665087:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69c7878800 for lustre-OST0000 00000001:00100000:2.0:1788483110.665260:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788483110.665264:0:9489:0:(genops.c:885:class_export_put()) final put ffff9a68c33c5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788483110.665284:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:2.0:1788483110.665287:0:9489:0:(genops.c:885:class_export_put()) final put ffff9a69c626e000/d93ec387-f41f-455a-afdd-b6a72a2f59de 00000020:00000080:3.0:1788483110.665336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33c5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788483110.665368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c626e000/d93ec387-f41f-455a-afdd-b6a72a2f59de for lustre-OST0001 00000020:00000080:3.0:1788483110.665382:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c33c7800 for lustre-OST0001 00000020:00000080:3.0:1788483110.665385:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69c626d800 for lustre-OST0001 00010000:00010000:2.0:1788483111.032894:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483111.161979:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483111.161986:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788483111.161989:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483111.161996:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 402 00000100:00080000:0.0:1788483111.162015:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788483111.162019:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1788483111.162022:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a69c5ff0000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483111.162038:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098720128:0@lo:400:kworker.0 00000100:00100000:0.0:1788483111.162044:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c37fad80 x1875360098720256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483111.162119:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483111.162137:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098720256:0@lo:38:kworker.0 00000100:00100000:0.0:1788483111.162166:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483111.162167:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098720384:0@lo:400:kworker.0 00000100:00100000:3.0:1788483111.162207:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483111.162212:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098720512:0@lo:400:kworker.0 00000100:00100000:3.0:1788483111.162223:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788483111.162235:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483111.162249:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720384 00000100:00100000:0.0:1788483111.162253:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098721024:0@lo:400:kworker.0 00000100:00100000:3.0:1788483111.162254:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720384 00000100:00100000:0.0:1788483111.162271:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483111.162325:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098720768:0@lo:400:kworker.0 00000100:00100000:1.0:1788483111.162357:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483111.162393:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720128 00000100:00100000:1.0:1788483111.162397:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720128 00000100:00100000:1.0:1788483111.162429:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788483111.162439:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:3620:x1875360098720128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483111.162483:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f8c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f2a9dc-d80b-4f65-b90d-3174e3881641+19:3620:x1875360098720128:12345-0@lo:400:kworker.0 Request processed in 45us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483111.162490:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788483111.162522:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720768 00000100:00100000:1.0:1788483111.162526:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720768 00000100:00100000:1.0:1788483111.162554:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788483111.162560:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098720768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483111.162604:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098720768:12345-0@lo:400:kworker.0 Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483111.162610:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788483111.162647:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098720768:0@lo:400:kworker.0 00000100:00100000:0.0:1788483111.162742:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788483111.162749:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098720640:0@lo:400:kworker.0 00000100:00100000:0.0:1788483111.162776:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483111.179618:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720512 00000100:00100000:3.0:1788483111.179632:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720512 00000100:00100000:3.0:1788483111.179671:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098721024 00000100:00100000:3.0:1788483111.179674:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098721024 00000100:00100000:3.0:1788483111.179697:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720640 00000100:00100000:3.0:1788483111.179712:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720640 00000100:00100000:3.0:1788483111.179736:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788483111.179744:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098721024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483111.179812:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098721024:12345-0@lo:400:kworker.0 Request processed in 69us (17539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483111.179819:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788483111.179835:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788483111.179842:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098720640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483111.179869:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098720640:12345-0@lo:400:kworker.0 Request processed in 28us (17093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483111.179875:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788483111.179887:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788483111.179891:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875360098720384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788483111.179898:0:6493:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788483111.179922:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875360098720384:12345-0@lo:400:kworker.0 Request processed in 30us (17715us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788483111.179928:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788483111.179941:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788483111.179961:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875360098720512:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788483111.179965:0:6493:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788483111.179989:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875360098720512:12345-0@lo:400:kworker.0 Request processed in 27us (17753us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788483111.179994:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788483111.180015:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483111.180058:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098720128:0@lo:400:kworker.0 00000100:00080000:3.0:1788483111.180085:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788483111.180117:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a69ece10800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788483111.180122:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788483111.192298:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720896 00000100:00100000:1.0:1788483111.192313:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720896 00000100:00100000:1.0:1788483111.192364:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788483111.192372:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875360098720896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788483111.192381:0:6495:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788483111.192459:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875360098720896:12345-0@lo:400:kworker.0 Request processed in 86us (12443us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788483111.192479:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788483111.192535:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098720256 00000100:00100000:1.0:1788483111.192540:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098720256 00000100:00100000:1.0:1788483111.192570:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788483111.192575:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098720256:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788483111.192604:0:6498:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788483111.192799:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483111.192805:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788483111.194649:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3f64380 x1875360098720640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483111.194667:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098720640:0@lo:400:kworker.0 00000100:00100000:2.0:1788483111.194694:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098721152:0@lo:400:kworker.0 00000100:00100000:2.0:1788483111.194748:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483111.194786:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098721152 00000100:00100000:2.0:1788483111.194792:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098721152 00000100:00100000:2.0:1788483111.194840:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788483111.194849:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098721152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483111.198277:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098721152:12345-0@lo:400:kworker.0 Request processed in 3419us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483111.198292:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1788483111.198333:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483111.198389:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098721152:0@lo:400:kworker.0 00000100:00080000:2.0:1788483111.198405:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788483111.198410:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788483111.198414:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788483111.198420:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483111.198424:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 177 00000100:00080000:2.0:1788483111.198430:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a69ed823800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483111.198464:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd937480 x1875360098721280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483111.198490:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098720512:0@lo:400:kworker.0 00010000:00080000:2.0:1788483111.198505:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c35f8700 x1875360098721024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483111.198514:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098721024:0@lo:400:kworker.0 00000100:00100000:0.0:1788483111.201398:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098721280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788483111.201474:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483111.201528:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098721280 00000100:00100000:0.0:1788483111.201535:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098721280 00000100:00100000:0.0:1788483111.201575:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788483111.201583:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098721280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788483111.201611:0:8434:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788483111.201653:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098721280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 69us (178us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483111.201660:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1788483111.201696:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483111.201701:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483111.201720:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098721280:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788483111.218676:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a69ece10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483111.218685:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 156 00000100:00080000:3.0:1788483111.218694:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a69ece10800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483111.218755:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c34fd180 x1875360098721408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483111.218785:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098720384:0@lo:400:kworker.0 00000100:00080000:3.0:1788483111.218814:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788483111.218818:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788483111.218821:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788483111.218825:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483111.218828:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 200 00000100:00080000:3.0:1788483111.218833:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a68c33c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483111.218846:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c34fdc00 x1875360098721536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483111.218855:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788483111.218875:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098721408:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788483111.218946:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483111.219005:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098721536:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788483111.219027:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483111.219200:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098721408 00000100:00100000:2.0:1788483111.219207:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098721408 00000100:00100000:2.0:1788483111.219244:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098721536 00000100:00100000:2.0:1788483111.219247:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098721536 00000100:00100000:2.0:1788483111.219267:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788483111.219274:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098721408:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788483111.219289:0:6493:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788483111.219327:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098721408:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 53us (382us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788483111.219333:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788483111.219346:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788483111.219350:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098721536:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788483111.219357:0:6493:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788483111.219376:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098721536:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 25us (349us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788483111.219382:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788483111.219516:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483111.219521:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483111.219524:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098721408:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788483111.219532:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483111.219535:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483111.219537:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098721536:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788483111.251443:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098720256:12345-0@lo:38:kworker.0 Request processed in 58855us (89264us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483111.251456:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:2.0:1788483111.256407:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483111.256422:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483111.256427:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098720256:0@lo:38:kworker.0 00000100:00100000:2.0:1788483111.672434:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483111.672457:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098721664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483111.672524:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483111.672661:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098721664 00000100:00100000:3.0:1788483111.672669:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098721664 00000100:00100000:3.0:1788483111.672720:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788483111.672730:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098721664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483111.672756:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788483111.672804:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098721664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483111.672823:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788483111.672870:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098721664:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788483112.056463:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483112.696758:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098721792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483112.696822:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483112.696984:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098721792 00000100:00100000:0.0:1788483112.696992:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098721792 00000100:00100000:0.0:1788483112.697043:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788483112.697053:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098721792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483112.697079:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788483112.697138:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098721792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483112.697145:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788483112.701092:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098721792:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788483113.080898:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483114.104498:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788483114.232412:0:15232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c3133ae0 - data ffff9a68c2062288/ffff9a68c3797800 00000020:01000000:0.0:1788483114.232604:0:15232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69f47f4c60 - data ffff9a69c6c7d798/ffff9a69ecc18000 00000001:00000004:0.0:1788483114.246402:0:15232:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788483114.298439:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788483114.298448:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788483114.298464:0:15232:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a68c37f8a80 x1875360098719488/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788483118 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483114.298487:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788483114.303149:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788483114.303157:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788483114.303176:0:15232:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788483114.303179:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788483114.304469:0:8547:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788483114.304475:0:8547:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788483114.304489:0:8547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788483114.305446:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788483114.305452:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788483114.305473:0:15232:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788483114.305476:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788483114.306187:0:9964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788483114.306192:0:9964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788483114.306203:0:9964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788483114.308044:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a0bb 00000020:00000080:1.0:1788483114.308055:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c626e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788483114.308170:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c626e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788483114.311341:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a0d0 00000020:00000080:1.0:1788483114.311356:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69d0f6d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788483114.311400:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788483114.311405:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.311412:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788483114.311417:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a69df0b3370) has no exports 00000004:01000000:1.0:1788483114.311604:0:15232:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788483114.311612:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a506 00000020:00000080:1.0:1788483114.311616:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a68c36b2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788483114.311691:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0f6d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788483114.311758:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788483114.311762:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.311771:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788483114.311774:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9a69c55f19b8) has no exports 00000020:00000080:1.0:1788483114.311787:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a4ff 00000020:00000080:1.0:1788483114.311791:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a68c36b5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788483114.311812:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788483114.312166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788483114.312286:0:15232:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788483114.312290:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788483114.312294:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788483114.312299:0:15232:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788483114.312301:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483114.312372:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.312380:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788483114.312386:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a3c4 00000020:00000080:1.0:1788483114.312392:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69efd41000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788483114.312417:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c36b7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788483114.312424:0:37:0:(genops.c:885:class_export_put()) final put ffff9a68c36b3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788483114.312427:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788483114.312431:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788483114.312622:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788483114.312626:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.312632:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788483114.312634:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a69c55f0000) has no exports 00000020:00000080:1.0:1788483114.312638:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a3bd 00000020:00000080:1.0:1788483114.312642:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69efd44000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788483114.312661:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd41000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788483114.313071:0:15232:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788483114.313074:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788483114.313077:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788483114.313080:0:15232:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788483114.313082:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483114.313163:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd44000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788483114.313305:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.313313:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788483114.313325:0:15232:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788483114.313330:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a274 00000020:00000080:1.0:1788483114.313335:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69ece9a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788483114.313340:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788483114.313344:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.313348:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788483114.313351:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a69f45e8000) has no exports 00000020:00000080:1.0:1788483114.313355:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a26d 00000020:00000080:1.0:1788483114.313366:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69e00f2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788483114.313640:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd40800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788483114.313648:0:37:0:(genops.c:885:class_export_put()) final put ffff9a68c2634800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788483114.313651:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c2634800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788483114.313655:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788483114.313710:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece9a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788483114.313715:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e00f2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788483114.328322:0:15232:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788483114.328333:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788483114.328338:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788483114.328347:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483114.328426:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.328440:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788483114.328515:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69e00f5000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788483114.328524:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69df32d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788483114.328527:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69df32d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788483114.328539:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788483114.328741:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.328746:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788483114.328750:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69d1341000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788483114.328753:0:15232:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d1341000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788483114.328759:0:15232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788483114.328853:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a0d7 00000020:00000080:1.0:1788483114.328860:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69d0f69800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788483114.328901:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788483114.328905:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.328910:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788483114.328914:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a69df0b4d28) has no exports 00000020:00000080:1.0:1788483114.328945:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.328948:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788483114.328952:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a0de 00000020:00000080:1.0:1788483114.328956:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69d0f6e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788483114.329020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0f69800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788483114.329032:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69d25dc000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788483114.329034:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d25dc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788483114.329037:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788483114.329255:0:15232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69d20cc000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788483114.329259:0:15232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d20cc000 3 00000020:01000004:1.0:1788483114.329262:0:15232:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a69d20cc000 from lustre-MDT0000 00000020:00000080:1.0:1788483114.329279:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.329284:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788483114.329287:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c6268000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788483114.329289:0:15232:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c6268000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788483114.329295:0:15232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788483114.329331:0:15232:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788483114.329335:0:15232:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788483114.329343:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788483114.329346:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.329349:0:15232:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788483114.329355:0:15232:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a69c5a5d800 e0f2a9dc-d80b-4f65-b90d-3174e3881641 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483114.329360:0:15232:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a69e009b370) has exports, disconnecting them 00000020:00080000:1.0:1788483114.329365:0:15232:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a69c5a5d800), last request at 1788482841 00000020:00000080:1.0:1788483114.329378:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a07c 00000020:00010000:1.0:1788483114.329382:0:15232:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a69c5a5d800: total 1 00000100:00080000:1.0:1788483114.329386:0:15232:0:(import.c:65:import_set_state_nolock()) ffff9a69c5a5f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788483114.329406:0:15232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69c5a5d800): rc 0 00000020:00080000:1.0:1788483114.329410:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a69e009b370) has no exports 00000100:00100000:1.0:1788483114.329468:0:6487:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a69df31e000:6487] 1 exiting: rc = 0 00000020:00010000:3.0:1788483114.329644:0:6482:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a69c5a5d800: total 1 00010000:00010000:3.0:1788483114.329684:0:6482:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a69c5a5d800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788483114.329712:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0e00/0x1d7ea3d89ea1a58b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a584 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329729:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2600/0x1d7ea3d89ea1a49d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a496 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329742:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030200/0x1d7ea3d89ea1a599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a592 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329752:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030800/0x1d7ea3d89ea1a5a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5a0 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329762:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1a5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ae expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329786:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1a5f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5ed expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329796:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0400/0x1d7ea3d89ea1a186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a17f expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329809:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1600/0x1d7ea3d89ea1a81d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a816 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329819:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030e00/0x1d7ea3d89ea1a5c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a5bc expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329829:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2400/0x1d7ea3d89ea1a178 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a171 expref: 5 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329841:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1a82b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a824 expref: 4 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329851:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1a839 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a832 expref: 3 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329862:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c0030000/0x1d7ea3d89ea1a57d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1a576 expref: 2 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483114.329872:0:6482:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a69c5a5d800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788483114.329886:0:6482:0:(genops.c:885:class_export_put()) final put ffff9a69c5a5d800/e0f2a9dc-d80b-4f65-b90d-3174e3881641 00000100:00100000:1.0:1788483114.329913:0:6486:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a69df31fa00:6486] 0 exiting: rc = 1 00000020:00000080:0.0:1788483114.330030:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0f6e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788483114.330079:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483114.330081:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483114.330083:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483114.330149:0:6488:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a69f47b0a00:6488] 2 exiting: rc = 0 00000020:00000080:0.0:1788483114.330242:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5a5d800/e0f2a9dc-d80b-4f65-b90d-3174e3881641 for MGS 00000020:00000080:0.0:1788483114.330277:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69c5a5f800 for MGS 00000100:00100000:1.0:1788483114.330645:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330655:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330665:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330675:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330683:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330694:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330703:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330709:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330722:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330775:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330783:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330788:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330794:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330799:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330805:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330810:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330816:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330822:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330828:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330833:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330846:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330852:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330858:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330863:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330869:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330875:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330881:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330886:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330892:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330899:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330904:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330909:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330915:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330921:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330926:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330932:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330938:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330943:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330948:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330954:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330959:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330965:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330970:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330976:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330981:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330986:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330992:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.330998:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331003:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331009:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331014:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331020:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331025:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331032:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331037:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331049:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331055:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331060:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331066:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331071:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331076:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331082:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331088:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483114.331192:0:15232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788483114.332213:0:15232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c34a7000 - data ffff9a68c200c360/ffff9a68c3743000 00000020:01000000:1.0:1788483114.332311:0:15232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69df150120 - data ffff9a69c6cbd870/ffff9a69f475e400 00000020:00000080:1.0:1788483114.332777:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a060 00000020:00000080:1.0:1788483114.332786:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c6a86000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788483114.332844:0:15232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69d20cc000 from MGS, refs=2 00000020:01000004:1.0:1788483114.332848:0:15232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d20cc000 2 00000020:01000004:1.0:1788483114.332852:0:15232:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a69d20cc000 from MGS 00000020:00000080:1.0:1788483114.332876:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.332882:0:15232:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788483114.332885:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c6a86800/MGS 00000020:00000080:1.0:1788483114.332887:0:15232:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c6a86800/MGS for MGS 00000020:01000000:1.0:1788483114.332893:0:15232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788483114.332954:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788483114.332958:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.332963:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788483114.332969:0:15232:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a69d0f4e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483114.332974:0:15232:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9a69e0098000) has exports, disconnecting them 00000020:00080000:1.0:1788483114.332979:0:15232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a69d0f4e000), last request at 1788482842 00000020:00000080:1.0:1788483114.332982:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a12b 00000020:00080000:1.0:1788483114.332988:0:15232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69d0f4e000): rc 0 00000020:00000080:1.0:1788483114.332991:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69d0f4e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788483114.333018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c6a86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788483114.333236:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0f4e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788483114.334007:0:15232:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788483114.334012:0:15232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788483114.334026:0:15232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788483114.334031:0:15232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483114.334234:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483114.334241:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788483114.334247:0:15232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d20cc000 1 00000020:00000080:1.0:1788483114.334251:0:15232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a052 00000020:00000080:1.0:1788483114.334257:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c6a83000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788483114.334444:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69d0f48800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788483114.334451:0:36:0:(genops.c:885:class_export_put()) final put ffff9a69d0f49000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788483114.334454:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0f49000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788483114.334459:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1788483114.334686:0:15232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788483114.334690:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483114.334694:0:15232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788483114.334697:0:15232:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a69d28799b8) has no exports 00000020:00000080:3.0:1788483114.337211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c6a83000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788483114.366872:0:15232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483114.366883:0:15232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788483114.366889:0:15232:0:(genops.c:885:class_export_put()) final put ffff9a69c2b8b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788483114.366893:0:15232:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c2b8b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788483114.366900:0:15232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788483114.367023:0:15232:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a69d20c8800 00000020:02000400:3.0:1788483114.367089:0:15232:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788483115.129912:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483116.155498:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483116.280776:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483116.280783:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788483116.280787:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483116.280795:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1788483116.280800:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788483116.280808:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a69c5ff0000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483116.280831:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35f8a80 x1875360098722048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483116.280849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483116.280853:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788483116.280855:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69ece10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483116.280858:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1788483116.280861:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788483116.280864:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a69ece10800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483116.280877:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35f8000 x1875360098722176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483116.280885:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483116.280888:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788483116.280896:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483116.280899:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1788483116.280902:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788483116.280906:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a69ed823800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483116.280918:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35fbb80 x1875360098722304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483116.280948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483116.280951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788483116.280952:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483116.280956:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1788483116.280958:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788483116.280962:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a68c33c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483116.280972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35f8700 x1875360098722688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483116.281014:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098722048:0@lo:38:kworker.0 00000100:00100000:0.0:1788483116.281078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483116.281150:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098722176:0@lo:38:kworker.0 00000100:00100000:0.0:1788483116.281176:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483116.281200:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098722304:0@lo:38:kworker.0 00000100:00100000:0.0:1788483116.281220:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483116.281240:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098722688:0@lo:38:kworker.0 00000100:00100000:0.0:1788483116.281260:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483116.281295:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722176 00000100:00100000:0.0:1788483116.281303:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722176 00000100:00100000:0.0:1788483116.281333:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722304 00000100:00100000:0.0:1788483116.281343:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722304 00000100:00100000:0.0:1788483116.281357:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722688 00000100:00100000:0.0:1788483116.281359:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722688 00000100:00100000:0.0:1788483116.281372:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788483116.281378:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098722176:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788483116.281395:0:6493:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788483116.281438:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098722176:12345-0@lo:38:kworker.0 Request processed in 58us (259us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483116.281444:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788483116.281462:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788483116.281465:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098722304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788483116.281474:0:6493:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788483116.281497:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098722304:12345-0@lo:38:kworker.0 Request processed in 30us (276us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483116.281502:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788483116.281511:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788483116.281515:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098722688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788483116.281524:0:6493:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788483116.281664:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098722432:0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.281692:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483116.281708:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788483116.281714:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098721920:0@lo:400:kworker.0 00000400:00000100:3.0:1788483116.281730:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360098721920 offset 0 length 224: 4 00000100:00100000:3.0:1788483116.281746:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098722944:0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.281768:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483116.281792:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098722816:0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.281812:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483116.281823:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483116.281828:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098722560:0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.281857:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483116.281883:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722432 00000100:00100000:3.0:1788483116.281887:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722432 00000100:00100000:3.0:1788483116.281922:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722816 00000100:00100000:3.0:1788483116.281925:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722816 00000100:00100000:3.0:1788483116.281940:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788483116.281946:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098722432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.281988:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098722432:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483116.281995:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788483116.282008:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788483116.282014:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098722816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.282046:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098722816:12345-0@lo:400:kworker.0 Request processed in 32us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483116.282052:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788483116.282069:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722944 00000100:00100000:3.0:1788483116.282073:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722944 00000100:00100000:3.0:1788483116.282114:0:8551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722560 00000100:00100000:3.0:1788483116.282117:0:8551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722560 00000100:00100000:3.0:1788483116.282140:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788483116.282147:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098722944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.282177:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098722944:12345-0@lo:400:kworker.0 Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483116.282184:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788483116.282195:0:8551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788483116.282201:0:8551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098722560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.282227:0:8551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098722560:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483116.282240:0:8551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1788483116.282262:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483116.282266:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483116.282268:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483116.282303:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098722560:0@lo:400:kworker.0 00010000:00080000:3.0:1788483116.282316:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a68c35f8380 x1875360098722816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483116.282325:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098722816:0@lo:400:kworker.0 00000100:00100000:3.0:1788483116.282359:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098722944:0@lo:400:kworker.0 00010000:00080000:3.0:1788483116.282370:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a68c35f9880 x1875360098722432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483116.282377:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098722432:0@lo:400:kworker.0 00000100:00100000:1.0:1788483116.282477:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098722048 00000100:00100000:1.0:1788483116.282482:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098722048 00000100:00100000:1.0:1788483116.282518:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788483116.282524:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098722048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788483116.282548:0:7805:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483116.282589:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098722048:12345-0@lo:38:kworker.0 Request processed in 65us (1511us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483116.282596:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788483116.284221:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098722688:12345-0@lo:38:kworker.0 Request processed in 2696us (2952us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483116.284233:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1788483116.284294:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483116.284299:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483116.284302:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098722048:0@lo:38:kworker.0 00000100:00080000:0.0:1788483116.284312:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483116.284315:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483116.284330:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098722176:0@lo:38:kworker.0 00000100:00080000:0.0:1788483116.284341:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483116.284344:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483116.284347:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098722304:0@lo:38:kworker.0 00000100:00080000:0.0:1788483116.284355:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483116.284359:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483116.284361:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098722688:0@lo:38:kworker.0 00000040:00080000:0.0:1788483116.536840:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483116.793306:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483116.797843:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098723072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483116.797949:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483116.798133:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723072 00000100:00100000:0.0:1788483116.798143:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723072 00000100:00100000:0.0:1788483116.798205:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788483116.798216:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098723072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483116.798256:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788483116.798315:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098723072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483116.798323:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788483116.798678:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098723072:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788483117.176834:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483117.827505:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483117.827661:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098723200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483117.827761:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483117.835685:0:11942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723200 00000100:00100000:2.0:1788483117.835704:0:11942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723200 00000100:00100000:2.0:1788483117.835778:0:11942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788483117.835804:0:11942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098723200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483117.835850:0:11942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788483117.835960:0:11942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098723200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (8199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483117.835968:0:11942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788483117.837235:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098723200:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788483118.201934:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788483118.579872:0:15433:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788483118.598236:0:15433:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788483118.598291:0:15433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.598304:0:15433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.598311:0:15433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.598318:0:15433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.598359:0:15433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788483118.598366:0:15433:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788483118.598391:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483118.598396:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788483118.598402:0:15433:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788483118.598408:0:15433:0:(import.c:65:import_set_state_nolock()) ffff9a69ece10800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788483118.598412:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483118.598414:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788483118.598417:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788483118.599972:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483118.599983:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483118.599993:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483118.599998:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483118.600008:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483118.600030:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483118.600036:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483118.600039:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788483118.600042:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788483118.600076:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483118.600083:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483118.600138:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483118.600146:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a200/0x1d7ea3d89ea1a5ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5b5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483118.600161:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483118.600162:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483118.600164:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483118.600321:0:15433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600330:0:15433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600337:0:15433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600344:0:15433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600368:0:15433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483118.600374:0:15433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600380:0:15433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600399:0:15433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600404:0:15433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600414:0:15433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788483118.600420:0:15433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600425:0:15433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600431:0:15433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600436:0:15433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600443:0:15433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788483118.600448:0:15433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600454:0:15433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600459:0:15433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600472:0:15433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483118.600478:0:15433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788483118.600481:0:15433:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788483118.600506:0:15433:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788483118.600510:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788483118.600515:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483118.600520:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000100:00100000:1.0:1788483118.601084:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483118.601122:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098723328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483118.601197:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788483118.601256:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788483118.601261:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601268:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483118.601272:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601279:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483118.601285:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483118.601290:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483118.601292:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1788483118.601294:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788483118.601315:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601321:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483118.601337:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601344:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1a5bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a5c3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601357:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788483118.601368:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601374:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c1528e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483118.601376:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601383:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483118.601389:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483118.601394:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483118.601396:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788483118.601398:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788483118.601413:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601418:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483118.601425:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601430:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c1528e00/0x1d7ea3d89ea1a496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a49d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601443:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483118.601446:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601451:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483118.601460:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601466:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483118.601472:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483118.601476:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788483118.601478:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788483118.601479:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788483118.601492:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601497:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483118.601507:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601513:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1a832 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a839 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601522:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483118.601604:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601610:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483118.601613:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601619:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483118.601631:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483118.601637:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483118.601639:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788483118.601640:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788483118.601654:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601659:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483118.601664:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601670:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7600/0x1d7ea3d89ea1a17f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1a186 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483118.601682:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483118.601684:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483118.601685:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483118.601699:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098723456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483118.601728:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483118.601749:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483118.601754:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098723584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483118.601772:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483118.601881:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483118.601896:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483118.601946:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723328 00000100:00100000:1.0:1788483118.601953:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723328 00000100:00100000:1.0:1788483118.602029:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723456 00000100:00100000:1.0:1788483118.602033:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723456 00000100:00100000:2.0:1788483118.602146:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098723840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483118.602174:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788483118.602226:0:15433:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a68c24e9800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788483118.602233:0:15433:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a68c24ed000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788483118.602238:0:15433:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9a69e009cd28) has exports, disconnecting them 00000020:00080000:3.0:1788483118.602243:0:15433:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a68c24e9800), last request at 1788483116 00000020:00000080:3.0:1788483118.602249:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a45e 00000100:00080000:3.0:1788483118.602265:0:15433:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ea000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788483118.602320:0:15433:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c24e9800): rc 0 00000020:00000080:3.0:1788483118.602322:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a68c24e9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788483118.602331:0:15433:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a68c24ed000), last request at 1788483116 00000020:00000080:3.0:1788483118.602334:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a338 00000100:00080000:3.0:1788483118.602339:0:15433:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ec000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788483118.602349:0:15433:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c24ed000): rc 0 00000020:00000080:3.0:1788483118.602351:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a68c24ed000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788483118.602357:0:15433:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb538415f7ae0 00000100:00080000:3.0:1788483118.602372:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483118.602379:0:15433:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9a69e03e2a00 x1875360098719872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788483126 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483118.602392:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788483118.603199:0:15433:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788483118.603206:0:15433:0:(import.c:65:import_set_state_nolock()) ffff9a69c5ff0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1788483118.605738:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483118.605758:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098723712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483118.606202:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723584 00000100:00100000:0.0:1788483118.606211:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723584 00000100:00100000:0.0:1788483118.606246:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723840 00000100:00100000:0.0:1788483118.606249:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723840 00000100:00100000:0.0:1788483118.606261:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788483118.606269:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3619:x1875360098723328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788483118.606276:0:6480:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483118 with bad export cookie 2125316224935108732 00000100:00100000:2.0:1788483118.610323:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483118.610437:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723712 00000100:00100000:2.0:1788483118.610448:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723712 00000100:00100000:2.0:1788483118.610485:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788483118.610494:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3621:x1875360098723456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788483118.610502:0:6479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483118 with bad export cookie 2125316224935108732 00000100:00100000:2.0:1788483118.610552:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3621:x1875360098723456:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (8823us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788483118.610572:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788483118.610591:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483118.610595:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3621:x1875360098723584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788483118.610600:0:6479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483118 with bad export cookie 2125316224935108732 00000100:00100000:2.0:1788483118.610628:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3621:x1875360098723584:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (8854us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788483118.610634:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483118.610663:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788483118.610668:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1875360098723840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788483118.610673:0:6479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483118 with bad export cookie 2125316224935108732 00000100:00100000:2.0:1788483118.610709:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1875360098723840:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (8534us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788483118.610716:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788483118.610728:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788483118.610732:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1875360098723712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788483118.610736:0:6479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483118 with bad export cookie 2125316224935108732 00000100:00100000:2.0:1788483118.610760:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1875360098723712:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (446us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788483118.610766:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788483118.610810:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788483118.610814:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a69e0122800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788483118.610818:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:1.0:1788483118.611403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24e9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788483118.611473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24ed000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788483118.611495:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24ea000 for lustre-MDT0001 00000020:00000080:1.0:1788483118.611500:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24ec000 for lustre-MDT0001 00000100:00080000:1.0:1788483118.611660:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788483118.611747:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788483118.611751:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788483118.611762:0:15433:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788483118.611830:0:15433:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788483118.611848:0:15433:0:(import.c:65:import_set_state_nolock()) ffff9a69efd14000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788483118.611869:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788483118.611872:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:3.0:1788483118.611880:0:15433:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788483118.611944:0:15433:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788483118.611953:0:15433:0:(import.c:65:import_set_state_nolock()) ffff9a69efd42000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788483118.611975:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a69e009cd28) has no exports 00000100:00100000:0.0:1788483118.617682:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098723968:0@lo:9:umount.0 00000100:00100000:0.0:1788483118.617770:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483118.617829:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098724096:0@lo:9:umount.0 00000100:00100000:0.0:1788483118.617851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483118.617900:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098723968 00000100:00100000:0.0:1788483118.617907:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098723968 00000100:00100000:0.0:1788483118.617960:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098724096 00000100:00100000:0.0:1788483118.617964:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098724096 00000100:00100000:0.0:1788483118.617988:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788483118.617996:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875360098723968:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788483118.618019:0:8412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a38c 00000100:00080000:0.0:1788483118.618034:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9a68c2631800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483118.618073:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788483118.618234:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3618:x1875360098723968:12345-0@lo:9:umount.0 Request processed in 238us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483118.618242:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788483118.618258:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788483118.618264:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875360098724096:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788483118.618275:0:8412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a4c7 00000100:00080000:0.0:1788483118.618281:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483118.618295:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788483118.618366:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3618:x1875360098724096:12345-0@lo:9:umount.0 Request processed in 102us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483118.618372:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788483118.618389:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483118.618392:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788483118.618406:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483118.618411:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483118.618435:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd14000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788483118.618450:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788483118.618452:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483118.618456:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098723968:0@lo:9:umount.0 00000100:00080000:0.0:1788483118.618470:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd42000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788483118.618481:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788483118.618483:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483118.618486:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098724096:0@lo:9:umount.0 00000100:00100000:0.0:1788483118.618790:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3619:x1875360098723328:12345-0@lo:103:ldlm_bl.0 Request processed in 12520us (17597us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788483118.618799:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788483118.622400:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788483118.643490:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788483118.643495:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788483118.643504:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a68c35f9f80 x1875360098721920/t0(0) o400->MGC192.168.206.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788483132 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483118.643683:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c5419180 x1875360098723328/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483134 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483118.643751:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c59e7b80 x1875360098723456/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483134 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483118.643760:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c59e5500 x1875360098723584/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483134 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483118.643768:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c59e5f80 x1875360098723840/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483134 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483118.643793:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c59e6300 x1875360098723712/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483134 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788483118.643802:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788483118.643804:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788483118.643805:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788483118.643846:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3622:1875360098721920:0@lo:400:kworker.0 00000100:00080000:1.0:1788483118.644007:0:3621:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a69e0122800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788483118.644152:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098723456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483118.644160:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098719872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483118.644191:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3621:1875360098723584:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788483118.644281:0:3619:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a69e0122800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788483118.644292:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3619:1875360098723328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483118.644311:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788483118.644402:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a69e0122800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483118.644409:0:3620:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 134 00000100:00080000:2.0:1788483118.644417:0:3620:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import ffff9a69e0122800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483118.644632:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd934e00 x1875360098724224/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483118.644660:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3618:1875360098724224:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788483118.644703:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360098724224 offset 0 length 520: 4 00000100:00100000:2.0:1788483118.644754:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098723840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483118.644766:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3620:1875360098723712:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788483118.651626:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a69e009cd28) has no exports 00000020:01000000:2.0:1788483118.742708:0:15433:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c3316540 - data ffff9a69c6f33a20/ffff9a68c3674400 00000020:01000000:2.0:1788483118.742864:0:15433:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69c2cfac60 - data ffff9a69c6c8ee58/ffff9a69ed814000 00000001:00000004:3.0:1788483118.758430:0:15433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788483118.800647:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483118.800657:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788483118.800666:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788483118.804083:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788483118.804091:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788483118.804170:0:15433:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483118.804172:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788483118.804614:0:8542:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788483118.804619:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788483118.804629:0:8542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788483118.805413:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788483118.805417:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:3.0:1788483118.805425:0:15433:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483118.805427:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788483118.806402:0:9960:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788483118.806407:0:9960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788483118.806418:0:9960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788483118.808435:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a1a2 00000020:00000080:3.0:1788483118.808447:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69df32b800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788483118.809977:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69df32b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788483118.810458:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a1b7 00000020:00000080:3.0:1788483118.810467:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69c5ff7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788483118.810478:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788483118.810483:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483118.810492:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483118.810496:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a69f45eb370) has no exports 00000004:01000000:3.0:1788483118.810977:0:15433:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788483118.810986:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a4c0 00000020:00000080:3.0:1788483118.810991:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69ed820000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788483118.810996:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788483118.810999:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483118.811007:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788483118.811009:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9a69c55f4d28) has no exports 00000020:00000080:3.0:1788483118.811015:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a4b9 00000020:00000080:3.0:1788483118.811018:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69ece9f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788483118.811309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5ff7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788483118.811317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ed820000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788483118.811321:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece9f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788483118.814047:0:15433:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788483118.814055:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788483118.814059:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:3.0:1788483118.814067:0:15433:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483118.814070:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788483118.814430:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483118.814445:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788483118.814453:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a37e 00000020:00000080:3.0:1788483118.814462:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a68c2637800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788483118.821024:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd42000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788483118.821042:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69ed822000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788483118.821045:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ed822000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788483118.821064:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788483118.822986:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788483118.823011:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483118.823023:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788483118.823028:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9a69edaa3370) has no exports 00000020:00000080:3.0:1788483118.823037:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a377 00000020:00000080:3.0:1788483118.823045:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69efd15000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788483118.823807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c2637800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788483118.824186:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd15000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788483118.824603:0:15433:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788483118.824609:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788483118.824625:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788483118.824632:0:15433:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483118.824635:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788483118.824717:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483118.824728:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788483118.824745:0:15433:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788483118.824754:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a1da 00000020:00000080:3.0:1788483118.824762:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69f62d6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788483118.824887:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd14000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788483118.824897:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69fd84b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788483118.824899:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69fd84b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788483118.824904:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788483118.826046:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788483118.826064:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483118.826073:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788483118.826077:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a69f61599b8) has no exports 00000020:00000080:3.0:1788483118.826085:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a1d3 00000020:00000080:3.0:1788483118.826091:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69f6155000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788483118.827359:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f62d6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788483118.827373:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f6155000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788483118.829249:0:15433:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788483118.829257:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483118.829261:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788483118.829270:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483118.829318:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483118.829328:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788483118.829352:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483118.829354:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788483118.829359:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69df32b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788483118.829362:0:15433:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69df32b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788483118.829374:0:15433:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788483118.829539:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a1be 00000020:00000080:0.0:1788483118.829546:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69c5ff4000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788483118.829551:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788483118.829563:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483118.829568:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788483118.829571:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a69e00999b8) has no exports 00000020:00000080:0.0:1788483118.829591:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483118.829595:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788483118.829598:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a1c5 00000020:00000080:0.0:1788483118.829602:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69c5ff1000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788483118.829609:0:15433:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69c5051000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788483118.829611:0:15433:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69c5051000 2 00000020:01000004:0.0:1788483118.829614:0:15433:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a69c5051000 from lustre-MDT0001 00000020:00000080:0.0:1788483118.829632:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483118.829635:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788483118.829637:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69d0f4f800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788483118.829639:0:15433:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0f4f800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788483118.829646:0:15433:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788483118.829673:0:15433:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788483118.829685:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788483118.829688:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483118.829691:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788483118.829697:0:15433:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a69ed820800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483118.829702:0:15433:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a69d287b370) has exports, disconnecting them 00000020:00080000:0.0:1788483118.829707:0:15433:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a69ed820800), last request at 1788482864 00000020:00000080:0.0:1788483118.829710:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a219 00000020:00080000:0.0:1788483118.829723:0:15433:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69ed820800): rc 0 00000020:00000080:0.0:1788483118.829726:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69ed820800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788483118.830448:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69c5ff0000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788483118.830458:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69f6152000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788483118.830460:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f6152000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788483118.830465:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788483118.830583:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5ff4000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788483118.830587:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69d0f4f000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788483118.830589:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0f4f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788483118.830593:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788483118.830750:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5ff1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788483118.830755:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ed820800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788483118.863136:0:15433:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788483118.863147:0:15433:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788483118.863151:0:15433:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788483118.863159:0:15433:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483118.863191:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece10800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788483118.863374:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483118.863383:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788483118.863388:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69ece26800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788483118.863391:0:15433:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece26800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788483118.863400:0:15433:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788483118.863468:0:15433:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69c5051000 1 00000020:00000080:1.0:1788483118.863475:0:15433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a155 00000020:00000080:1.0:1788483118.863482:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69c5052800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788483118.863491:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788483118.863499:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5052800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788483118.863508:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483118.863513:0:15433:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788483118.863516:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a69c55f3370) has no exports 00000020:00000080:0.0:1788483119.116296:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483119.116309:0:15433:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788483119.116314:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69c5053000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788483119.116319:0:15433:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5053000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788483119.116331:0:15433:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788483119.116440:0:15433:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a69c5056800 00000020:01000000:0.0:1788483119.116458:0:15433:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788483119.116462:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483119.116466:0:15433:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788483119.116470:0:15433:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a69df0b19b8) has no exports 00000100:00100000:0.0:1788483119.116544:0:6495:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a69f47b3e00:6495] 2 exiting: rc = 0 00000100:00100000:0.0:1788483119.116656:0:6494:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a69c30f1600:6494] 1 exiting: rc = 0 00000100:00100000:3.0:1788483119.116979:0:8434:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a68c1c82000:8434] 3 exiting: rc = 0 00000100:00100000:2.0:1788483119.117189:0:6493:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a69c50a4a00:6493] 0 exiting: rc = 1 00000100:00100000:0.0:1788483119.117499:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117508:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117514:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117520:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117527:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117533:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117539:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117544:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117562:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117569:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117588:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117594:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117599:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117605:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117610:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117615:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117620:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117626:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117631:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117636:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117641:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117647:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117652:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117658:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117663:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117669:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117674:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117680:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117685:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117690:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117696:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117701:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117706:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117713:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117718:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117723:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117727:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117745:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117753:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117758:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117764:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117769:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117775:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117846:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117854:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117865:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117870:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117875:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117881:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117886:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117891:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117895:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117900:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117906:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117912:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117917:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117922:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117929:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117934:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117940:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117946:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117952:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117958:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.117970:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483119.125009:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a69c5b4d400:6497] 1 exiting: rc = 0 00000100:00100000:2.0:1788483119.125257:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a69c5b4d200:6496] 0 exiting: rc = 1 00000100:00100000:0.0:1788483119.125374:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125382:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125388:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125395:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125402:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125409:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125415:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125421:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125427:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125432:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125438:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125444:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125458:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125463:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125469:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125474:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125495:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125501:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125506:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125511:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125516:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125522:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125528:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125533:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125539:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125544:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125561:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125567:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125573:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125578:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125583:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125589:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125594:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125600:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125606:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125611:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125617:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125623:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125629:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125634:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125639:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125644:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125650:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125655:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125660:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125665:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125671:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125676:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125681:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125686:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125691:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125704:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125709:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125714:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125721:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125726:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125732:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125737:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125743:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125748:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125754:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125759:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125765:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.125771:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483119.128161:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a69f47f1e00:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1788483119.128510:0:7805:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9a69ed86b400:7805] 2 exiting: rc = 0 00000100:00100000:3.0:1788483119.128852:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a69e008fa00:6498] 0 exiting: rc = 1 00000100:00100000:0.0:1788483119.128944:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.128967:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.128974:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.128979:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.128984:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.128990:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.128995:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129000:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129006:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129016:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129024:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129029:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129035:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129041:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129046:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129052:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129058:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129064:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129071:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129076:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129082:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129136:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129153:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129159:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129165:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129171:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129176:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129181:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129188:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129193:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129199:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129205:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129212:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129233:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129239:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129245:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129250:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129256:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129261:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129267:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129272:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129278:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129283:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129289:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129294:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129312:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129318:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129324:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129330:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129336:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129342:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129347:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129353:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129358:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129364:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129369:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129376:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129403:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129410:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129418:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129425:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129431:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129437:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.129449:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483119.146697:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a69c509b600:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1788483119.147260:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a69c509b800:6501] 1 exiting: rc = 0 00000100:00100000:2.0:1788483119.147366:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147374:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147378:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147382:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147387:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147392:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147397:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147402:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147407:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147429:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147434:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147440:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147445:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147450:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147456:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147461:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147466:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147471:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147477:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147481:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147486:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147491:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147497:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147502:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147508:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147513:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147518:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147523:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147528:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147533:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147538:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147543:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147548:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147567:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147573:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147578:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147582:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147587:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147592:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147598:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147603:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147608:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147613:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147619:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147632:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147637:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147641:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147646:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147650:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147655:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147660:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147665:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147669:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147675:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147679:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147684:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147688:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147693:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147697:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147702:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147706:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147711:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147715:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.147721:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483119.148276:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a69c30c0400:6503] 1 exiting: rc = 0 00000100:00100000:0.0:1788483119.148389:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a69c5918000:6502] 0 exiting: rc = 1 00000100:00100000:2.0:1788483119.148470:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148476:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148481:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148487:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148492:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148498:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148504:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148509:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148513:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148518:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148524:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148529:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148534:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148539:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148544:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148571:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148576:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148581:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148590:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148595:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148600:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148605:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148610:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148615:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148620:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148625:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148630:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148635:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148640:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148644:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148650:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148654:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148660:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148664:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148669:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148675:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148681:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148686:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148691:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148696:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148700:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148705:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148710:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148714:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148719:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148724:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148729:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148734:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148738:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148744:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148756:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148760:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148765:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148770:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148775:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148841:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148846:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148850:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148854:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148859:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148864:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148869:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148874:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.148880:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483119.150997:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a69f45e7c00:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1788483119.158131:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a69c3093800:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1788483119.158252:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158260:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158265:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158269:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158274:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158279:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158284:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158289:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158294:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158301:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158306:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158311:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158316:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158321:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158325:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158330:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158334:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158339:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158344:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158348:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158353:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158373:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158378:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158383:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158387:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158391:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158396:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158402:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158406:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158410:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158415:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158420:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158424:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158429:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158433:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158437:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158442:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158447:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158451:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158456:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158461:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158466:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158470:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158474:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158480:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158484:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158489:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158495:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158499:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158504:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158508:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158512:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158517:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158522:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158527:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158532:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158544:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158558:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158565:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158570:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158574:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158579:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158584:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.158589:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.159086:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a69c616c200:6508] 2 exiting: rc = 0 00000100:00100000:0.0:1788483119.159308:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a69f47f6400:6507] 1 exiting: rc = 0 00000100:00100000:1.0:1788483119.160740:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a69f47f6a00:6506] 0 exiting: rc = 1 00000100:00100000:2.0:1788483119.160810:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160817:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160822:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160827:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160832:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160837:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160851:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160858:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160864:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160869:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160875:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160880:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160885:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160890:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160896:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160920:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160927:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160933:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160938:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160944:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160950:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160955:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160961:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160966:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160972:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160977:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.160995:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161001:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161007:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161013:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161019:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161026:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161031:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161037:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161042:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161048:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161055:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161061:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161067:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161087:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161123:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161131:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161137:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161142:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161147:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161153:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161159:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161165:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161171:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161177:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161182:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161187:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161192:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161198:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161204:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161209:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161213:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161218:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161224:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161228:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161233:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161247:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161252:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483119.161257:0:15433:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788483119.165468:0:15433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483119.165480:0:15433:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788483119.165485:0:15433:0:(genops.c:885:class_export_put()) final put ffff9a69d25da800/MDS_uuid 00000020:00000080:2.0:1788483119.165490:0:15433:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d25da800/MDS_uuid for MDS 00000020:01000000:2.0:1788483119.165496:0:15433:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788483119.165627:0:15433:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788483119.230834:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483120.257655:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483121.279797:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788483121.400165:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483121.400174:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483121.400177:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483121.400180:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788483121.400184:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483121.400191:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 408 00000100:00080000:2.0:1788483121.400196:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788483121.400202:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a69ed823800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483121.400252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd935500 x1875360098724352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483121.400310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483121.400314:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788483121.400315:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483121.400318:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 408 00000100:00080000:2.0:1788483121.400321:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788483121.400325:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a68c33c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483121.400338:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd935c00 x1875360098724608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483121.400388:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098724736:0@lo:400:kworker.0 00000400:00000100:2.0:1788483121.400432:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098724736 offset 0 length 224: 4 00000100:00100000:2.0:1788483121.400481:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483121.400487:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098724480:0@lo:400:kworker.0 00000400:00000100:2.0:1788483121.400503:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098724480 offset 0 length 224: 4 00000100:00100000:0.0:1788483121.400711:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098724352:0@lo:38:kworker.0 00000400:00000100:0.0:1788483121.400734:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098724352 offset 0 length 520: 4 00000100:00100000:0.0:1788483121.400755:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098724608:0@lo:38:kworker.0 00000400:00000100:0.0:1788483121.400771:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098724608 offset 0 length 520: 4 00010000:00010000:1.0:1788483122.297818:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788483123.271999:0:15634:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788483123.292461:0:15634:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788483123.292511:0:15634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483123.292526:0:15634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483123.292546:0:15634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483123.292555:0:15634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483123.292597:0:15634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788483123.292603:0:15634:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788483123.292633:0:15634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483123.292643:0:15634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69fd935500 x1875360098724352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483123.292665:0:15634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788483123.292671:0:15634:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788483123.292677:0:15634:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788483123.292681:0:15634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483123.292685:0:15634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69fd935500 x1875360098724352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483141 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483123.292700:0:15634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788483123.292703:0:15634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:1.0:1788483123.292812:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483123.292819:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.292828:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483123.292832:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.292851:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483123.292859:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483123.292866:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483123.292868:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788483123.292870:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788483123.292883:0:7446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:1.0:1788483123.292887:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.292893:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1a592 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a599 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.292905:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483123.292907:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483123.292909:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483123.293190:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098724352:0@lo:38:kworker.0 00000100:00080000:3.0:1788483123.294598:0:15634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788483123.294612:0:15634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69fd936680 x1875360098724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483137 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483123.294637:0:15634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788483123.294643:0:15634:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788483123.294665:0:15634:0:(import.c:65:import_set_state_nolock()) ffff9a68c24e9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788483123.294729:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098724864:0@lo:39:umount.0 00000400:00000100:1.0:1788483123.294780:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098724864 offset 0 length 224: 4 00000100:00100000:2.0:1788483123.294877:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098724480:0@lo:400:kworker.0 00010000:00010000:3.0:1788483123.320294:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788483123.448252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483123.448263:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483123.448266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483123.448270:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483123.448643:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483123.448665:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098724992:0@lo:400:kworker.0 00000400:00000100:1.0:1788483123.448717:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098724992 offset 0 length 224: 4 00010000:00010000:1.0:1788483124.344248:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788483124.475643:0:8405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788483124.475653:0:8405:0:(genops.c:885:class_export_put()) final put ffff9a68c2635800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788483124.475732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c2635800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788483124.475797:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c2631800 for lustre-OST0000 00000001:00100000:3.0:1788483124.479128:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788483124.479139:0:9489:0:(genops.c:885:class_export_put()) final put ffff9a68c33a7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788483124.479360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33a7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788483124.479724:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c33a5000 for lustre-OST0001 00010000:00010000:1.0:1788483125.369379:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483126.395401:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483126.457841:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483126.457850:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483126.457854:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483126.457858:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483126.458009:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098725120:0@lo:400:kworker.0 00000400:00000100:3.0:1788483126.458059:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098725120 offset 0 length 224: 4 00010000:00010000:1.0:1788483127.416350:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483128.440231:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483118/real 1788483118] req@ffff9a69fd934e00 x1875360098724224/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483128 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483128.440263:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69fd934e00 x1875360098724224/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483128 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788483128.440283:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e0122800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483128.440305:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788483128.440309:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3618:1875360098724224:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788483128.440423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483128.440428:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788483128.440431:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69e0122800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483128.440451:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1788483128.440456:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788483128.440462:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import ffff9a69e0122800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483128.440511:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c5418380 x1875360098725248/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483128.440533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483128.440538:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483128.440588:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483128.440599:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098725376:0@lo:400:kworker.0 00000400:00000100:0.0:1788483128.440647:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098725376 offset 0 length 224: 4 00000100:00100000:1.0:1788483128.442221:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3618:1875360098725248:0@lo:250:kworker.0 00000400:00000100:1.0:1788483128.442269:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360098725248 offset 0 length 520: 4 00010000:00010000:0.0:1788483128.444383:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483129.464461:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483130.488311:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483131.513625:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483132.536839:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483133.560343:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483123/real 1788483123] req@ffff9a68c35f9f80 x1875360098724864/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483133 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483133.560388:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a68c35f9f80 x1875360098724864/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483133 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788483133.560406:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c24e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788483133.560430:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098724864:0@lo:39:umount.0 00000100:00080000:3.0:1788483133.560517:0:15634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788483133.560522:0:15634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788483133.560528:0:15634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788483133.561492:0:15634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561508:0:15634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561515:0:15634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561522:0:15634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561543:0:15634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483133.561551:0:15634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561558:0:15634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561564:0:15634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561571:0:15634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483133.561588:0:15634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788483133.561593:0:15634:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788483133.561625:0:15634:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788483133.561630:0:15634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788483133.561634:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483133.561639:0:15634:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788483133.561644:0:15634:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a69d2878000) has no exports 00000020:00080000:3.0:1788483133.561666:0:15634:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a69d2878000) has no exports 00000020:01000000:3.0:1788483133.563318:0:15634:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c33165a0 - data ffff9a68c20c3ca8/ffff9a69edb73c00 00010000:00010000:0.0:1788483133.563490:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483133.563500:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563510:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483133.563514:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563524:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483133.563532:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483133.563537:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483133.563540:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788483133.563557:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788483133.563573:0:7446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:0.0:1788483133.563577:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563584:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77e00/0x1d7ea3d89ea1a5a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a5a7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563602:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483133.563606:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563611:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483133.563614:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563621:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483133.563626:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483133.563632:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788483133.563634:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788483133.563635:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788483133.563641:0:7446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:0.0:1788483133.563644:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563649:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9200/0x1d7ea3d89ea1a824 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a82b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483133.563669:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483133.563670:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483133.563672:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483133.564083:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483133.564207:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788483133.568537:0:15634:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69c2cfab40 - data ffff9a69c6db0438/ffff9a69fd920c00 00100000:10000000:3.0:1788483133.579440:0:15634:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788483133.590699:0:15634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a2f2 00000020:00000080:0.0:1788483133.590718:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a69ece99000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788483133.590746:0:15634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69e00f6800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788483133.590750:0:15634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69e00f6800 2 00000020:01000004:0.0:1788483133.590753:0:15634:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a69e00f6800 from lustre-OST0000 00000020:00000080:0.0:1788483133.590788:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483133.590801:0:15634:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788483133.590804:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a69ece9b000/lustre-OST0000_UUID 00000020:00000080:0.0:1788483133.590808:0:15634:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece9b000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788483133.590815:0:15634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788483133.590884:0:15634:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788483133.590889:0:15634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788483133.590894:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483133.590899:0:15634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788483133.590908:0:15634:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a69fd849000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483133.590914:0:15634:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9a69d287cd28) has exports, disconnecting them 00000020:00080000:0.0:1788483133.590920:0:15634:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a69fd849000), last request at 1788482885 00000020:00000080:0.0:1788483133.590925:0:15634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a31c 00000020:00080000:0.0:1788483133.590934:0:15634:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69fd849000): rc 0 00000020:00000080:0.0:1788483133.590940:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a69fd849000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788483133.591029:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece99000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788483133.591047:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69fd849000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788483133.596220:0:15634:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788483133.596231:0:15634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788483133.596237:0:15634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788483133.596246:0:15634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788483133.596513:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ed823800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788483133.596817:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483133.596829:0:15634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788483133.596836:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a69ece98000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788483133.596841:0:15634:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece98000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788483133.596850:0:15634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788483133.596941:0:15634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788483133.596946:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483133.596952:0:15634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788483133.596961:0:15634:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a68c24ea800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483133.596969:0:15634:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9a68c24e19b8) has exports, disconnecting them 00000020:00080000:2.0:1788483133.596975:0:15634:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a68c24ea800), last request at 1788482885 00000020:00000080:2.0:1788483133.596980:0:15634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a331 00000020:00080000:2.0:1788483133.597010:0:15634:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c24ea800): rc 0 00000020:00000080:2.0:1788483133.597016:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a68c24ea800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788483133.598066:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24ea800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788483133.606219:0:15634:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788483133.606234:0:15634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788483133.606241:0:15634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788483133.606252:0:15634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483133.606296:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24e9000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788483133.606547:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483133.606561:0:15634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788483133.606568:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a69ed825800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788483133.606573:0:15634:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ed825800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788483133.606589:0:15634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788483133.606696:0:15634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69e00f6800 1 00000020:00000080:1.0:1788483133.606704:0:15634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a2ba 00000020:00000080:1.0:1788483133.606713:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a69f6157000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788483133.606723:0:15634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788483133.606732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f6157000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788483133.606743:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483133.606748:0:15634:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788483133.606753:0:15634:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a69edaa19b8) has no exports 00000100:00080000:1.0:1788483133.690752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483133.690766:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483133.690769:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483133.690772:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483133.690867:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483133.690896:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098725504:0@lo:400:kworker.0 00000400:00000100:1.0:1788483133.690969:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098725504 offset 0 length 224: 4 00000020:00000080:1.0:1788483133.756963:0:15634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483133.756984:0:15634:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788483133.756991:0:15634:0:(genops.c:885:class_export_put()) final put ffff9a69e00f4800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788483133.756997:0:15634:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e00f4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788483133.757011:0:15634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788483133.757218:0:15634:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a69e00f2000 00000020:02000400:1.0:1788483133.757276:0:15634:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788483134.584606:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483135.609317:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483136.633481:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788483137.593483:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483121/real 1788483121] req@ffff9a69fd934a80 x1875360098724736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483137 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483137.621013:0:3622:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9a69fd934a80 x1875360098724736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483137 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483137.621030:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a2000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788483137.621034:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788483137.638211:0:3622:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788483137.638501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483137.638508:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483137.638518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483137.638521:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483137.638524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483137.638528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788483137.638531:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483137.638540:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 200 00000100:00080000:0.0:1788483137.638548:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a68c33a2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483137.638580:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c5418000 x1875360098725632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483137.638771:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098724736:0@lo:400:kworker.0 00000100:00100000:3.0:1788483137.641855:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098725632:0@lo:38:kworker.0 00000400:00000100:3.0:1788483137.641919:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098725632 offset 0 length 520: 4 00010000:00010000:2.0:1788483137.658304:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788483138.070842:0:15836:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788483138.078400:0:15836:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788483138.078493:0:15836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.078507:0:15836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.078515:0:15836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.078535:0:15836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.078635:0:15836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788483138.078641:0:15836:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788483138.078738:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483138.078750:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69fd935c00 x1875360098724608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.078774:0:15836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788483138.078781:0:15836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788483138.078787:0:15836:0:(import.c:65:import_set_state_nolock()) ffff9a68c33c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788483138.078791:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483138.078795:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69fd935c00 x1875360098724608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483141 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.078802:0:15836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788483138.078805:0:15836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1788483138.078869:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098724608:0@lo:38:kworker.0 00010000:00010000:1.0:1788483138.079529:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483138.079537:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483138.079546:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483138.079550:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483138.079559:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483138.079565:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483138.079583:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483138.079585:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788483138.079588:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788483138.079601:0:6482:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:1.0:1788483138.079613:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483138.079620:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77600/0x1d7ea3d89ea1a576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a57d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483138.079634:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483138.079636:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483138.079638:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788483138.079914:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788483138.079923:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69fd936680 x1875360098724992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483139 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.079946:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c5419c00 x1875360098725120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483142 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.079955:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c541ad80 x1875360098725376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.080013:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c59e5500 x1875360098725504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.080036:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c5418000 x1875360098725632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483147 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.080057:0:15836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788483138.080061:0:15836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788483138.080065:0:15836:0:(import.c:65:import_set_state_nolock()) ffff9a68c33a2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788483138.080069:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788483138.080072:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098725120:0@lo:400:kworker.0 00000100:00100000:3.0:1788483138.080073:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69fd936680 x1875360098724992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483139 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.080080:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c5419c00 x1875360098725120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483142 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483138.080131:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098725504:0@lo:400:kworker.0 00000100:00100000:3.0:1788483138.080170:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c541ad80 x1875360098725376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483144 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483138.080215:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098725376:0@lo:400:kworker.0 00000100:00100000:3.0:1788483138.080235:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c59e5500 x1875360098725504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483149 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.080242:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c5418000 x1875360098725632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483147 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483138.080248:0:15836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788483138.080729:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098724992:0@lo:400:kworker.0 00000100:00100000:2.0:1788483138.080845:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098725632:0@lo:38:kworker.0 00000100:00100000:3.0:1788483138.080878:0:15836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788483138.082087:0:15836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.082282:0:15836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.082290:0:15836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.082297:0:15836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.082376:0:15836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483138.082385:0:15836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.082393:0:15836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.082398:0:15836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483138.082405:0:15836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082432:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483138.082438:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082445:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ae00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483138.082449:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082466:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483138.082473:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483138.082479:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483138.082481:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788483138.082492:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:0.0:1788483138.082501:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082508:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8ae00/0x1d7ea3d89ea1a584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a58b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082523:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483138.082526:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082532:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77000 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483138.082535:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082614:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483138.082620:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483138.082625:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788483138.082627:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788483138.082632:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:0.0:1788483138.082634:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483138.082641:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483138.082643:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483138.082645:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483138.082762:0:15836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788483138.082766:0:15836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1a816 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a81d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483138.082780:0:15836:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788483138.082784:0:15836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788483138.082787:0:15836:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788483138.082810:0:15836:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788483138.082814:0:15836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788483138.082819:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483138.082825:0:15836:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788483138.082829:0:15836:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9a68c24e3370) has no exports 00000020:00080000:3.0:1788483138.082851:0:15836:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9a68c24e3370) has no exports 00000020:01000000:3.0:1788483138.084861:0:15836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c31334e0 - data ffff9a68c2044948/ffff9a69edb7e800 00000020:01000000:3.0:1788483138.085034:0:15836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c31331e0 - data ffff9a69e0787af8/ffff9a68c35fc400 00010000:00010000:2.0:1788483138.085177:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788483138.096047:0:15836:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788483138.101351:0:15836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a418 00000020:00000080:2.0:1788483138.101362:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a69fd848000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788483138.101373:0:15836:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c1c41000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788483138.101377:0:15836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c1c41000 2 00000020:01000004:2.0:1788483138.101379:0:15836:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a68c1c41000 from lustre-OST0001 00000020:00000080:2.0:1788483138.101409:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483138.101417:0:15836:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788483138.101434:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a69ece9e800/lustre-OST0001_UUID 00000020:00000080:1.0:1788483138.101436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69fd848000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788483138.101438:0:15836:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece9e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788483138.101450:0:15836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788483138.101605:0:15836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e0f2a9dc-d80b-4f65-b90d-3174e3881641->MGS 00010000:00010000:2.0:1788483138.101620:0:15836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6600/0x1d7ea3d89ea1a171 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a178 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483138.101632:0:15836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6600/0x1d7ea3d89ea1a171 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a178 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483138.101639:0:15836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788483138.101642:0:15836:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788483138.101645:0:15836:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788483138.101659:0:15836:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:2.0:1788483138.101672:0:15836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6600/0x1d7ea3d89ea1a171 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a178 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483138.101687:0:15836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1a5f4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483138.101707:0:15836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1a5f4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483138.101713:0:15836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483138.101716:0:15836:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788483138.101717:0:15836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788483138.101727:0:15836:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69e0122800 00010000:00010000:2.0:1788483138.101730:0:15836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0600/0x1d7ea3d89ea1a5ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1a5f4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788483138.101747:0:15836:0:(import.c:65:import_set_state_nolock()) ffff9a69e0122800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788483138.101750:0:15836:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788483138.101752:0:15836:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788483138.101754:0:15836:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788483138.101757:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788483138.101767:0:15836:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69c5418380 x1875360098725248/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788483143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788483138.101786:0:15836:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788483138.101789:0:15836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1788483138.101899:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0f2a9dc-d80b-4f65-b90d-3174e3881641:3618:1875360098725248:0@lo:250:kworker.0 10000000:01000000:2.0:1788483138.102200:0:15836:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788483138.102209:0:15836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a06e 00000020:00000080:2.0:1788483138.102215:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a69d25dd000/e0f2a9dc-d80b-4f65-b90d-3174e3881641 00000020:01000000:2.0:1788483138.102225:0:15836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.154@tcp (flags='') 00000020:00000080:2.0:1788483138.102229:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483138.102235:0:15836:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788483138.102239:0:15836:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a69f45ecd28) has no exports 00000020:00000080:1.0:1788483138.102250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d25dd000/e0f2a9dc-d80b-4f65-b90d-3174e3881641 for MGC192.168.206.154@tcp 10000000:01000000:0.0:1788483138.102742:0:6491:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788483138.102771:0:15836:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.154@tcp: client import never connected 00000100:00080000:2.0:1788483138.102775:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788483138.102777:0:15836:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788483138.102781:0:15836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788483138.102790:0:15836:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788483138.102823:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483138.102829:0:15836:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.154@tcp (uuid e0f2a9dc-d80b-4f65-b90d-3174e3881641) 00000020:01000000:2.0:1788483138.102836:0:15836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788483138.102838:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69e0122800 for MGC192.168.206.154@tcp 00000020:00000080:2.0:1788483138.102840:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483138.102847:0:15836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1788483138.102849:0:36:0:(genops.c:885:class_export_put()) final put ffff9a69e0126800/e0f2a9dc-d80b-4f65-b90d-3174e3881641 00000020:00080000:2.0:1788483138.102853:0:15836:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a68c24ef800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1788483138.102855:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e0126800/e0f2a9dc-d80b-4f65-b90d-3174e3881641 for MGC192.168.206.154@tcp 00000020:01000000:1.0:1788483138.102863:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.154@tcp (e0f2a9dc-d80b-4f65-b90d-3174e3881641) 00000020:00080000:2.0:1788483138.102864:0:15836:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9a68c24e0000) has exports, disconnecting them 00000020:00080000:2.0:1788483138.102871:0:15836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a68c24ef800), last request at 1788482907 00000020:00000080:2.0:1788483138.102875:0:15836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a442 00000020:00080000:2.0:1788483138.102887:0:15836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c24ef800): rc 0 00000020:00000080:2.0:1788483138.102892:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a68c24ef800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788483138.103245:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24ef800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788483138.123527:0:15836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788483138.123535:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788483138.123543:0:15836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788483138.123550:0:15836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483138.123783:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c33c2000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788483138.123972:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483138.123980:0:15836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788483138.123985:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a69ece21800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788483138.123989:0:15836:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece21800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788483138.123997:0:15836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788483138.124061:0:15836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788483138.124065:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483138.124069:0:15836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788483138.124075:0:15836:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a68c33a0000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483138.124081:0:15836:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9a69edaa0000) has exports, disconnecting them 00000020:00080000:2.0:1788483138.124086:0:15836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a68c33a0000), last request at 1788482907 00000020:00000080:2.0:1788483138.124090:0:15836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a457 00000020:00080000:2.0:1788483138.124132:0:15836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c33a0000): rc 0 00000020:00000080:2.0:1788483138.124137:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a68c33a0000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788483138.124194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33a0000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788483138.129230:0:15836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788483138.129239:0:15836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788483138.129243:0:15836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788483138.129250:0:15836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788483138.129633:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788483138.129949:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c33a2000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788483138.134017:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788483138.134619:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788483138.134719:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a69f4508200:6476] 0 exiting: rc = 1 00000100:00100000:1.0:1788483138.134851:0:6477:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a69f4509200:6477] 1 exiting: rc = 0 00000100:00100000:3.0:1788483138.140219:0:9499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9a68c27e4800:9499] 2 exiting: rc = 0 00000100:00100000:3.0:1788483138.140336:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.141341:0:7436:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a69ecdc8000:7436] 3 exiting: rc = 0 00000100:00100000:1.0:1788483138.141600:0:6478:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a69f4508600:6478] 0 exiting: rc = 1 00000100:00100000:2.0:1788483138.145270:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a69f4509800:6479] 1 exiting: rc = 0 00000100:00100000:0.0:1788483138.145352:0:6480:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a69f8d5ae00:6480] 2 exiting: rc = 0 00000100:00100000:3.0:1788483138.145658:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145665:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145671:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145676:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145681:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145688:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145695:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145701:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145706:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145711:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145716:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145722:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145727:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145732:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145737:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145742:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145747:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145753:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145758:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145763:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145768:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145772:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145778:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145784:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145791:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145808:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145813:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145818:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145823:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145827:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145832:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145838:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145843:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145848:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145854:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145859:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145864:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145868:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145873:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145877:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145881:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145886:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145891:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145895:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145899:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145904:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145908:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145913:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.145917:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146018:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146024:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146030:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146035:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146040:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146046:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146051:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146055:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146060:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146064:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146069:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146081:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146086:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146090:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.146122:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788483138.148079:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483138.148090:0:15836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788483138.148123:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a68c33a6000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788483138.148128:0:15836:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c33a6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788483138.148134:0:15836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788483138.148181:0:15836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c1c41000 1 00000020:00000080:3.0:1788483138.148188:0:15836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1a3e7 00000020:00000080:3.0:1788483138.148194:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a68c27c7000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788483138.148205:0:15836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788483138.148209:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483138.148214:0:15836:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483138.148218:0:15836:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9a69f6158000) has no exports 00000020:00000080:1.0:1788483138.150880:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c27c7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788483138.197554:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483138.197567:0:15836:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788483138.197572:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a68c27c1000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788483138.197576:0:15836:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c27c1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788483138.197587:0:15836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788483138.197902:0:15836:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a68c1c47800 00000020:01000000:3.0:1788483138.197922:0:15836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788483138.197927:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483138.197931:0:15836:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788483138.197935:0:15836:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a69f615b370) has no exports 00000020:00000080:3.0:1788483138.197954:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483138.197960:0:15836:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788483138.197963:0:15836:0:(genops.c:885:class_export_put()) final put ffff9a69f6153000/OSS_uuid 00000020:00000080:3.0:1788483138.197965:0:15836:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f6153000/OSS_uuid for OSS 00000020:01000000:3.0:1788483138.197968:0:15836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788483138.198053:0:8551:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a68c1c39e00:8551] 3 exiting: rc = 0 00000100:00100000:1.0:1788483138.198236:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a69ecdda200:8411] 1 exiting: rc = 0 00000100:00100000:2.0:1788483138.198342:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a69ece3f200:8409] 0 exiting: rc = 1 00000100:00080000:0.0:1788483138.198551:0:6489:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788483138.198664:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a69c30b2200:8412] 2 exiting: rc = 0 00000100:00100000:3.0:1788483138.199378:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199403:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199410:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199416:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199422:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199427:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199433:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199438:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199443:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199465:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199471:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199476:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199481:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199487:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199492:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199497:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199503:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199508:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199513:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199518:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199523:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199528:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199533:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199538:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199543:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199548:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199553:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199558:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199563:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199568:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199573:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199578:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199583:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199590:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199596:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199601:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199614:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199619:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199628:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199633:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199637:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199641:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199646:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199651:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199655:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199660:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199665:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199670:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199675:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199680:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199686:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199690:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199694:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199699:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199704:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199709:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199714:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199718:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199723:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199727:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199731:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199736:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199740:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.199826:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483138.204245:0:11942:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a69c5a1e800:11942] 2 exiting: rc = 0 00000100:00100000:1.0:1788483138.204714:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a69ecdd8600:8413] 0 exiting: rc = 1 00000100:00100000:0.0:1788483138.208675:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a69f5463000:8414] 1 exiting: rc = 0 00000100:00100000:3.0:1788483138.211141:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211150:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211155:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211160:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211166:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211198:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211204:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211219:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211224:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211229:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211234:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211239:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211243:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211249:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211254:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211259:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211264:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211269:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211274:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211279:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211284:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211289:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211293:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211298:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211303:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211308:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211313:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211318:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211323:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211328:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211332:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211337:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211341:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211347:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211352:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211357:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211362:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211368:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211372:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211378:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211382:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211386:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211399:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211404:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211409:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211414:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211419:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211424:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211429:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211435:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211440:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211445:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211464:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211472:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211476:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211481:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211486:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211491:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211497:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211501:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211507:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211512:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211517:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.211528:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.218241:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a69c5b4c200:8417] 2 exiting: rc = 0 00000100:00100000:2.0:1788483138.219612:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a69c5b4d800:8416] 1 exiting: rc = 0 00000100:00100000:2.0:1788483138.219851:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a69f63c7a00:8415] 0 exiting: rc = 1 00000100:00100000:1.0:1788483138.219925:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219934:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219940:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219945:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219952:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219966:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219974:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219981:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219988:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.219997:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220004:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220010:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220014:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220020:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220025:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220030:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220035:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220050:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220056:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220061:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220074:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220080:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220085:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220090:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220109:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220115:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220135:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220142:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220148:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220156:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220162:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220168:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220174:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220182:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220188:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220195:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220201:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220206:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220212:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220217:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220224:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220247:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220256:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220262:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220268:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220273:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220278:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220283:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220289:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220295:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220300:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220305:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220315:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220320:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220325:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220337:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220342:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220348:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220354:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220359:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220370:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220379:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220385:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483138.220390:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483138.228183:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a69d0f13e00:8418] 0 exiting: rc = 1 00000100:00100000:0.0:1788483138.228321:0:9966:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9a69f63cde00:9966] 2 exiting: rc = 0 00000100:00100000:2.0:1788483138.228435:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a69f614d800:8419] 1 exiting: rc = 0 00000100:00100000:0.0:1788483138.234188:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234197:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234203:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234209:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234214:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234219:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234224:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234229:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234234:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234238:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234243:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234248:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234252:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234256:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234261:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234265:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234270:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234274:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234280:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234284:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234289:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234293:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234298:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234302:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234306:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234311:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234325:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234329:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234334:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234339:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234344:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234348:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234352:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234357:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234362:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234366:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234371:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234376:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234380:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234385:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234389:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234393:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234398:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234402:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234407:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234411:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234416:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234420:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234425:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234431:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234437:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234442:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234447:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234464:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234471:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234476:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234481:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234486:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234490:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234495:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234500:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234511:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234516:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.234522:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237114:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a69f5462c00:8420] 0 exiting: rc = 1 00000100:00100000:3.0:1788483138.237287:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a69f5463800:8421] 1 exiting: rc = 0 00000100:00100000:0.0:1788483138.237434:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237467:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237476:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237484:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237489:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237495:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237502:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237509:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237515:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237521:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237538:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237545:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237552:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237557:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237563:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237569:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237575:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237581:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237587:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237592:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237597:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237604:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237624:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237631:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237637:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237643:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237649:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237654:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237659:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237666:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237671:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237691:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237696:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237702:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237723:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237729:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237735:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237741:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237758:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237764:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237769:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237774:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237779:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237785:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237790:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237796:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237815:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237824:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237829:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237835:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237840:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237846:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237851:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237857:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237862:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237868:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237874:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237880:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237899:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237907:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237912:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237918:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237923:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483138.237935:0:15836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788483138.252024:0:15836:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788483159.286071:0:16600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788483172.527418:0:17201:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788483172.527423:0:17201:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788483172.527424:0:17201:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788483172.527537:0:17201:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a69ece13000 00000020:01000004:2.0:1788483172.527551:0:17201:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788483172.527558:0:17201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788483172.527570:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a69edaa4d28) 00000020:00000080:2.0:1788483172.527582:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788483172.597090:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788483172.597682:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.598410:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.598621:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.598881:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.599239:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.599507:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.599712:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.600090:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.600394:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.600582:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.600778:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.601260:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.601502:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.601730:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.602036:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.602428:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.602613:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.602882:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.603235:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.603510:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.603735:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.604477:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.604714:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.605132:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.605415:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.605622:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.605861:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.606222:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.606516:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.606742:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.607155:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.607382:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788483172.607573:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788483172.608209:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.608510:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788483172.609205:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788483172.609488:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788483172.609716:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.609996:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.610484:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.610684:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788483172.610987:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788483172.611376:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.611609:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.611965:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788483172.613428:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.616692:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.617421:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.617657:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.618309:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.618564:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788483172.621726:0:17201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788483172.622602:0:17201:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788483172.622810:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788483172.622818:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483172.622828:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b62b 00000020:01000004:3.0:1788483172.622834:0:17201:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788483172.622838:0:17201:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788483172.622843:0:17201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69ece13000 from MGS 00000020:01000004:3.0:1788483172.622846:0:17201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788483172.622854:0:17201:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a69f6158000) 00000020:00000080:3.0:1788483172.622863:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788483172.622947:0:17201:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69ece13000 from MGS, refs=2 00080000:01000000:3.0:1788483172.622952:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788483172.622957:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b639 00000100:00100000:3.0:1788483172.623055:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788483172.623200:0:17201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788483172.623205:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788483172.626178:0:17201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788483172.626189:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788483172.627624:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483172.627797:0:17201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788483172.627803:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788483172.628422:0:17201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788483172.628430:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788483172.629766:0:17201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788483172.629775:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788483172.630582:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483172.630585:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483172.630587:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483172.630873:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483172.630876:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483172.630878:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483172.632908:0:17201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788483172.634309:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788483172.649775:0:17201:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788483172.658044:0:17213:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788483172.658145:0:17201:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788483172.658196:0:17201:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788483172.663063:0:17201:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788483172.663404:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483172.663546:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788483172.663552:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788483172.664621:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788483172.664629:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788483172.664910:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788483172.664916:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788483172.665670:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788483172.665688:0:17201:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.154@tcp' 00000020:01000004:2.0:1788483172.665690:0:17201:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788483172.665717:0:17201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.154@tcp (typ=mgc) 00000020:00000080:2.0:1788483172.665729:0:17201:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.154@tcp (ffff9a69edaa0000) 00000020:00000080:2.0:1788483172.665742:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788483172.665814:0:17201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69ece11800@MGC192.168.206.154@tcp: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483172.665953:0:17201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.154@tcp-0 is initialized 00000040:01000000:2.0:1788483172.665959:0:17201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788483172.666478:0:17218:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788483172.671304:0:17219:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788483172.671393:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.154@tcp (uuid 4be19e4a-e21c-409c-93a6-e1423c5e2099) 00000020:00000080:0.0:1788483172.671415:0:17201:0:(genops.c:1385:class_connect()) connect: client 4be19e4a-e21c-409c-93a6-e1423c5e2099, cookie 0x1d7ea3d89ea1b647 00000100:00080000:0.0:1788483172.671427:0:17201:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788483172.671432:0:17201:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import ffff9a69ece11800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483172.671461:0:17201:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c5418380 x1875360098725760/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483172.671503:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098725760:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788483172.671562:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788483172.671618:0:17201:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS 00000020:01000004:0.0:1788483172.671640:0:17201:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788483172.671644:0:17201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788483172.671657:0:17201:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a68c24e4d28) 00000020:00000080:0.0:1788483172.671669:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788483172.672060:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098725760 00000100:00100000:3.0:1788483172.672067:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098725760 00000100:00100000:3.0:1788483172.672128:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483172.672135:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3618:x1875360098725760:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788483172.672156:0:17215:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4be19e4a-e21c-409c-93a6-e1423c5e2099@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1788483172.672177:0:17215:0:(genops.c:1385:class_connect()) connect: client 4be19e4a-e21c-409c-93a6-e1423c5e2099, cookie 0x1d7ea3d89ea1b655 00000100:00080000:3.0:1788483172.672289:0:17215:0:(import.c:65:import_set_state_nolock()) ffff9a69efebc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483172.672342:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+5:3618:x1875360098725760:12345-0@lo:250:mount.lustre.0 Request processed in 206us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483172.672359:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483172.672410:0:3618:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788483172.672417:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.154@tcp: connect to target with instance 0 00000100:00080000:3.0:1788483172.672423:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788483172.672426:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788483172.672429:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788483172.672432:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788483172.672438:0:3618:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788483172.672443:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098725760:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788483172.698889:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483172.699055:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788483172.699061:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788483172.708524:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788483172.708536:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788483172.708915:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788483172.708934:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788483172.709558:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483172.709724:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788483172.709729:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788483172.712046:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788483172.712060:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788483172.738689:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483172.738882:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788483172.738888:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788483172.740635:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788483172.740644:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788483172.742583:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483172.742755:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788483172.742761:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788483172.745603:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788483172.745621:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788483172.746434:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483172.746613:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788483172.746617:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788483172.746969:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788483172.746974:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788483172.760647:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483172.760839:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788483172.760846:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788483172.764644:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788483172.764658:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788483172.784064:0:17201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483172.784632:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788483172.784637:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788483172.786069:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788483172.786077:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788483172.789501:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788483172.789517:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788483172.790980:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788483172.791009:0:17201:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788483172.791015:0:17201:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788483172.791147:0:17201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788483172.791180:0:17201:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788483172.791184:0:17201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788483172.791185:0:17201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483172.791187:0:17201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483172.791188:0:17201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483172.791190:0:17201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483172.791191:0:17201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483172.791192:0:17201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483172.791194:0:17201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483172.791195:0:17201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483172.791201:0:17201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483172.791203:0:17201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788483172.791205:0:17201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483172.791207:0:17201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483172.791208:0:17201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483172.791209:0:17201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483172.791210:0:17201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483172.791211:0:17201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483172.791212:0:17201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483172.791213:0:17201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483172.791214:0:17201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483172.791215:0:17201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483172.791350:0:17201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788483172.791369:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098725888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483172.791491:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483172.791587:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace600 going to sleep for 11 seconds 00000100:00100000:2.0:1788483172.791602:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098725888 00000100:00100000:2.0:1788483172.791610:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098725888 00000100:00100000:2.0:1788483172.791653:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483172.791666:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+5:17201:x1875360098725888:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483172.791707:0:17217:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788483172.791709:0:17217:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788483172.791712:0:17217:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788483172.792081:0:17238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788483172.798879:0:17217:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788483172.805918:0:17239:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788483172.805926:0:17239:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788483172.805929:0:17239:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788483172.805932:0:17239:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788483172.806119:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788483172.806307:0:17217:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788483172.806317:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788483172.807624:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+5:17201:x1875360098725888:12345-0@lo:253:mount.lustre.0 Request processed in 15957us (16126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483172.807640:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483172.807754:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098725888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788483172.807766:0:17201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788483172.807769:0:17201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788483172.807770:0:17201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483172.807772:0:17201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483172.807777:0:17201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483172.807779:0:17201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483172.807780:0:17201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483172.807781:0:17201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483172.807783:0:17201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483172.807784:0:17201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483172.807785:0:17201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788483172.807803:0:17201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69ece13000 from lustre-MDT0000 10000000:01000000:3.0:1788483172.807829:0:17201:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788483172.807832:0:17201:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788483172.807835:0:17201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a69edaa0000 10000000:01000000:3.0:1788483172.807839:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483172.807845:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a69edaa0000 from 1 10000000:01000000:3.0:1788483172.807848:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788483172.807878:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.807888:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.807896:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483172.807913:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483172.807947:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483172.808015:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483172.808057:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726016 00000100:00100000:2.0:1788483172.808063:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726016 00000100:00100000:2.0:1788483172.808145:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483172.808154:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+5:17201:x1875360098726016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483172.808166:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483172.808179:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1b663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b65c expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483172.808198:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1b663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b65c expref: 6 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483172.808206:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1b663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b65c expref: 6 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483172.808214:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77e00, rc 0) 00000100:00100000:2.0:1788483172.808256:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+6:17201:x1875360098726016:12345-0@lo:101:mount.lustre.0 Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483172.808269:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483172.808336:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483172.808348:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.808356:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483172.808398:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483172.808421:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483172.808566:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788483172.808628:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726144 00000100:00100000:3.0:1788483172.808632:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726144 00000100:00100000:3.0:1788483172.808651:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483172.808656:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+6:17201:x1875360098726144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483172.808720:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+6:17201:x1875360098726144:12345-0@lo:501:mount.lustre.0 Request processed in 63us (298us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788483172.808733:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788483172.808796:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726144:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788483172.808821:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788483172.808840:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.808847:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483172.808854:0:17201:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69ece13000 10000000:01000000:1.0:1788483172.808858:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788483172.808861:0:17201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a69ece13000 10000000:01000000:1.0:1788483172.808862:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788483172.808865:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a69ece13000 from 1 10000000:01000000:1.0:1788483172.808867:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788483172.808882:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.808889:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.808896:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483172.808905:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483172.808927:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483172.808939:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788483172.808993:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726272 00000100:00100000:3.0:1788483172.808997:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726272 00000100:00100000:3.0:1788483172.809011:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483172.809016:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+6:17201:x1875360098726272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483172.809022:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483172.809032:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2400/0x1d7ea3d89ea1b671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b66a expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.809044:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2400/0x1d7ea3d89ea1b671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b66a expref: 7 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.809052:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2400/0x1d7ea3d89ea1b671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b66a expref: 7 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.809058:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2400, rc 0) 00000100:00100000:3.0:1788483172.809088:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+7:17201:x1875360098726272:12345-0@lo:101:mount.lustre.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483172.809093:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788483172.809169:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483172.809178:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.809185:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483172.809199:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788483172.809211:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.809217:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483172.809223:0:17201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788483172.809225:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788483172.809228:0:17201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a69ece13000 10000000:01000000:1.0:1788483172.809230:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788483172.809232:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788483172.809234:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788483172.809253:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.809259:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.809265:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483172.809286:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483172.809306:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483172.809320:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788483172.809415:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726400 00000100:00100000:3.0:1788483172.809419:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726400 00000100:00100000:3.0:1788483172.809434:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483172.809438:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+7:17201:x1875360098726400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483172.809444:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483172.809450:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b67f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b678 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.809461:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b678 expref: 8 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.809474:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b678 expref: 8 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483172.809480:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3c00, rc 0) 00000100:00100000:3.0:1788483172.809510:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+8:17201:x1875360098726400:12345-0@lo:101:mount.lustre.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483172.809515:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788483172.809573:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483172.809581:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483172.809593:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483172.809626:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483172.809646:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483172.809664:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788483172.809707:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726528 00000100:00100000:3.0:1788483172.809711:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726528 00000100:00100000:3.0:1788483172.809725:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483172.809729:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+8:17201:x1875360098726528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483172.809825:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17201:x1875360098726528:12345-0@lo:501:mount.lustre.0 Request processed in 95us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483172.809831:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788483172.809887:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483172.809920:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483172.809954:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483172.809970:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788483172.810014:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726656 00000100:00100000:3.0:1788483172.810017:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726656 00000100:00100000:3.0:1788483172.810031:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483172.810035:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17201:x1875360098726656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483172.810566:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17201:x1875360098726656:12345-0@lo:503:mount.lustre.0 Request processed in 528us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483172.810573:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483172.810644:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098726656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483172.810988:0:17240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17240:1875360098726784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483172.811022:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483172.811048:0:17240:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483172.811113:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726784 00000100:00100000:3.0:1788483172.811117:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726784 00000100:00100000:3.0:1788483172.811142:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788483172.811147:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17240:x1875360098726784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483172.811540:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17240:x1875360098726784:12345-0@lo:502:llog_process_th.0 Request processed in 391us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483172.811551:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483172.811627:0:17240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17240:1875360098726784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788483172.811647:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483172.811656:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483172.811658:0:17240:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788483172.811663:0:17240:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788483172.811665:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788483172.811677:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a69c55f3370) 00000020:00000080:1.0:1788483172.811695:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788483172.811699:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788483172.811769:0:17240:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788483172.811775:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b68d 00000020:00000080:1.0:1788483172.811999:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788483172.812004:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483172.812007:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483172.812008:0:17240:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788483172.812011:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483172.812014:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483172.812015:0:17240:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788483172.812018:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788483172.812024:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a69c55f4d28) 00000020:00000080:1.0:1788483172.812037:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788483172.812040:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788483172.812042:0:17240:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788483172.812045:0:17240:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788483172.812050:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788483172.812087:0:17240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69ece13000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788483172.812121:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a69c55f0000) 00000020:00000080:1.0:1788483172.812128:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788483172.812172:0:17240:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788483172.812177:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1b6a2 00000020:00000080:1.0:1788483172.812334:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788483172.812340:0:17240:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788483172.812344:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1d7ea3d89ea1b6a9 00080000:01000000:1.0:1788483172.812348:0:17240:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788483172.812351:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b6b0 00010000:00010000:0.0:1788483172.872543:0:17240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788483172.881749:0:17240:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788483172.882763:0:17240:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788483172.886037:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a69f615cd28) 00000020:00000080:3.0:1788483172.886059:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788483172.886187:0:17240:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788483172.886194:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b6be 00000020:00000080:3.0:1788483172.897652:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788483172.904723:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1d7ea3d89ea1b6c5 00000020:00000080:3.0:1788483172.909766:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788483172.909780:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483172.909787:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.909789:0:17240:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788483172.909793:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788483172.909796:0:17240:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788483172.909797:0:17240:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483172.909799:0:17240:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483172.909800:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788483172.909802:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.909804:0:17240:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788483172.909806:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483172.909812:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.909813:0:17240:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788483172.909817:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788483172.909866:0:17240:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788483172.909884:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483172.909887:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.909888:0:17240:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788483172.909891:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483172.909893:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.909894:0:17240:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788483172.909910:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788483172.909915:0:17240:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:00000080:3.0:1788483172.909952:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483172.909968:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a69f615b370) 00000020:00000080:3.0:1788483172.909984:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788483172.909989:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788483172.910044:0:17240:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788483172.910050:0:17240:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788483172.910070:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b6d3 00010000:00080000:3.0:1788483172.910125:0:17240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69ed823000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:3.0:1788483172.916625:0:17240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788483172.920306:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788483172.920329:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788483172.920375:0:17240:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788483172.920395:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1b6da 00000100:00080000:0.0:1788483172.920405:0:17240:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788483172.920411:0:17240:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69ed823000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483172.920447:0:17240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c5419180 x1875360098726912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483172.920470:0:17240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788483172.920530:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483172.920534:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483172.920536:0:17240:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788483172.920540:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788483172.920542:0:17240:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788483172.920544:0:17240:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788483172.920545:0:17240:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788483172.920547:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788483172.920549:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483172.920551:0:17240:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788483172.920553:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788483172.920557:0:17240:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788483172.920560:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483172.920561:0:17240:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788483172.920564:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788483172.920568:0:17240:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:0.0:1788483172.920591:0:17240:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788483172.920594:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788483172.920606:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a68c24e0000) 00000020:00000080:0.0:1788483172.920616:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788483172.920621:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788483172.920688:0:17240:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788483172.920695:0:17240:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788483172.920701:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b6e8 00010000:00080000:0.0:1788483172.920731:0:17240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69d18c9800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:0.0:1788483172.920925:0:17240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788483172.921961:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098726912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483172.922025:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483172.922266:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098726912 00000100:00100000:2.0:1788483172.922284:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098726912 00000100:00100000:2.0:1788483172.922328:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483172.922336:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098726912:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788483172.922351:0:17227:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1788483172.926516:0:17240:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788483172.927185:0:17240:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788483172.950657:0:17240:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483172.952473:0:17240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788483172.964724:0:17240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788483172.970736:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788483172.970743:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788483172.971571:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788483172.971583:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788483172.971620:0:17240:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788483172.971640:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1b6ef 00000100:00080000:3.0:1788483172.971649:0:17240:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788483172.971655:0:17240:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a69d18c9800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483172.971685:0:17240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35f9880 x1875360098727040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483172.971754:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098727040:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788483172.971805:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098727040 offset 0 length 520: 4 00000100:00080000:3.0:1788483172.972412:0:17240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788483172.972475:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483172.972481:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.972482:0:17240:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788483172.972485:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788483172.972487:0:17240:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788483172.972498:0:17240:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483172.972500:0:17240:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483172.972501:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788483172.972504:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.972505:0:17240:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788483172.972507:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788483172.972511:0:17240:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788483172.972514:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483172.972515:0:17240:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788483172.972518:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788483172.972521:0:17240:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:3.0:1788483172.972541:0:17240:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788483172.972543:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483172.972555:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a69f61599b8) 00000020:00000080:3.0:1788483172.972569:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788483172.972573:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788483172.972633:0:17240:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788483172.972639:0:17240:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788483172.972644:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1b6fd 00010000:00080000:3.0:1788483172.972670:0:17240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69efd93800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:3.0:1788483172.972867:0:17240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788483172.972931:0:17240:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788483172.972946:0:17240:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788483172.988546:0:17240:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483172.988798:0:17240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788483172.988944:0:17240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788483172.989829:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098726912:12345-0@lo:38:llog_process_th.0 Request processed in 67488us (67799us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483172.989845:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788483172.989963:0:17248:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788483172.989968:0:17248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00080000:2.0:1788483172.991421:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483172.991429:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483172.991434:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098726912:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788483173.004680:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788483173.004693:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788483173.004733:0:17240:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788483173.004760:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1b704 00000100:00080000:3.0:1788483173.004770:0:17240:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788483173.004776:0:17240:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69efd93800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483173.004808:0:17240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35f8e00 x1875360098727168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483173.004837:0:17240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788483173.004890:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483173.004896:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483173.004898:0:17240:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788483173.004902:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483173.004906:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483173.004908:0:17240:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788483173.004911:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788483173.004913:0:17240:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788483173.004916:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483173.004919:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483173.004920:0:17240:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788483173.004924:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483173.004926:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483173.004928:0:17240:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788483173.004932:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788483173.004974:0:17240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17240:1875360098727296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.005042:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483173.005083:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098727296 00000100:00100000:3.0:1788483173.005090:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098727296 00000100:00100000:3.0:1788483173.005151:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483173.005159:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17240:x1875360098727296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483173.006827:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098727168:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788483173.006883:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098727168 offset 0 length 520: 4 00000100:00100000:2.0:1788483173.007788:0:17240:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df15d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.008669:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17240:x1875360098727296:12345-0@lo:502:llog_process_th.0 Request processed in 3506us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483173.008682:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483173.012558:0:17240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17240:1875360098727296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483173.012719:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483173.012731:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483173.012733:0:17240:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788483173.012738:0:17240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788483173.012914:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788483173.012947:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788483173.012967:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483173.012994:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483173.013002:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69ece13000 from 1 10000000:01000000:1.0:1788483173.013005:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483173.013040:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483173.013047:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483173.013065:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483173.013087:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483173.013180:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483173.013214:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3eaec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483173.013654:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098727424 00000100:00100000:2.0:1788483173.013662:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098727424 00000100:00100000:2.0:1788483173.013706:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483173.013716:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+9:17201:x1875360098727424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483173.013730:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483173.013744:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b70b expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.013765:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 10 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.013774:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 10 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.013792:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76400, rc 0) 00000100:00100000:2.0:1788483173.013831:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+10:17201:x1875360098727424:12345-0@lo:101:mount.lustre.0 Request processed in 117us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483173.013837:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788483173.014139:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483173.014153:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483173.014162:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483173.014890:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727552:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788483173.016367:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483173.016459:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3eaec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.020638:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098727552 00000100:00100000:3.0:1788483173.020660:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098727552 00000100:00100000:3.0:1788483173.020731:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483173.020741:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+10:17201:x1875360098727552:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788483173.020766:0:17215:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788483173.020772:0:17215:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788483173.020891:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+10:17201:x1875360098727552:12345-0@lo:256:mount.lustre.0 Request processed in 152us (5955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483173.020899:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788483173.021146:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727552:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788483173.021737:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788483173.021755:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483173.021766:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483173.021774:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69ece13000 from 1 10000000:01000000:1.0:1788483173.021777:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483173.021808:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483173.021816:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483173.021825:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483173.021843:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483173.021886:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483173.022210:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3eaec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483173.026825:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098727680 00000100:00100000:0.0:1788483173.026841:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098727680 00000100:00100000:0.0:1788483173.026952:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483173.026964:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+10:17201:x1875360098727680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483173.026980:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483173.027000:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b719 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.027025:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 11 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.027035:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 11 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.027043:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8e00, rc 0) 00000100:00100000:1.0:1788483173.028326:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17201:x1875360098727680:12345-0@lo:101:mount.lustre.0 Request processed in 1358us (6433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483173.028337:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483173.028561:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483173.028583:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.028612:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483173.028692:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483173.028728:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483173.028768:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2799f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483173.030180:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098727808 00000100:00100000:2.0:1788483173.030192:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098727808 00000100:00100000:2.0:1788483173.030548:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788483173.030559:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17201:x1875360098727808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483173.030735:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17201:x1875360098727808:12345-0@lo:501:mount.lustre.0 Request processed in 177us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483173.030743:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483173.030872:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483173.030952:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483173.030996:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483173.031029:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2799f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483173.031537:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098727936 00000100:00100000:2.0:1788483173.031543:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098727936 00000100:00100000:2.0:1788483173.031580:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483173.031588:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17201:x1875360098727936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483173.031694:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17201:x1875360098727936:12345-0@lo:503:mount.lustre.0 Request processed in 107us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483173.031702:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788483173.032429:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098727936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483173.034703:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17250:1875360098728064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483173.034779:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483173.034822:0:17250:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.034877:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728064 00000100:00100000:3.0:1788483173.034886:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728064 00000100:00100000:3.0:1788483173.034932:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788483173.034949:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17250:x1875360098728064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483173.035808:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17250:x1875360098728064:12345-0@lo:502:llog_process_th.0 Request processed in 857us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483173.035818:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483173.035920:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17250:1875360098728064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788483173.035958:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483173.035967:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483173.035976:0:17250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788483173.035983:0:17250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69ece13000 00000020:00000080:2.0:1788483173.035986:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483173.035993:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483173.035996:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483173.035998:0:17250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788483173.036000:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483173.036003:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483173.036004:0:17250:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788483173.036008:0:17250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69ece13000 00000020:00000080:2.0:1788483173.036010:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483173.036177:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483173.036181:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483173.036183:0:17250:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788483173.036186:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483173.036189:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483173.036190:0:17250:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788483173.036194:0:17250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69ece13000 00000020:00000080:2.0:1788483173.036196:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483173.046497:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483173.046580:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483173.046583:0:17250:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788483173.046589:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483173.046595:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483173.046596:0:17250:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788483173.046601:0:17250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69ece13000 00000020:00000080:0.0:1788483173.046604:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788483173.046688:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17250:1875360098728192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483173.046762:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483173.046808:0:17250:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2799600 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.046865:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728192 00000100:00100000:3.0:1788483173.046874:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728192 00000100:00100000:3.0:1788483173.046975:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788483173.046985:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17250:x1875360098728192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.047141:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17250:x1875360098728192:12345-0@lo:502:llog_process_th.0 Request processed in 157us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483173.047149:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788483173.047232:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17250:1875360098728192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788483173.047281:0:17250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483173.047287:0:17250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483173.047288:0:17250:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788483173.047291:0:17250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788483173.049963:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788483173.049996:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788483173.050014:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.050025:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483173.050114:0:17201:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788483173.050117:0:17201:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69ece13000 10000000:01000000:2.0:1788483173.050119:0:17201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69ece13000 10000000:01000000:2.0:1788483173.050124:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788483173.050129:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69ece13000 from 1 10000000:01000000:2.0:1788483173.050131:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788483173.050164:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.050171:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.050181:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483173.050203:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098728320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483173.050286:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483173.066648:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483173.072961:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728320 00000100:00100000:0.0:1788483173.072988:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728320 00000100:00100000:0.0:1788483173.073042:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788483173.073050:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17201:x1875360098728320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483173.073080:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483173.073122:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b727 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.073151:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b727 expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.073160:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b727 expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.073168:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8400, rc 0) 00000100:00100000:0.0:1788483173.073264:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17201:x1875360098728320:12345-0@lo:101:mount.lustre.0 Request processed in 214us (22976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483173.073280:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788483173.077356:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098728320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483173.077384:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.077398:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483173.077483:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098728448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483173.077538:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483173.077592:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788483173.077609:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728448 00000100:00100000:2.0:1788483173.077615:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728448 00000100:00100000:2.0:1788483173.077645:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788483173.077653:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17201:x1875360098728448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483173.077770:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17201:x1875360098728448:12345-0@lo:501:mount.lustre.0 Request processed in 117us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483173.077778:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788483173.078079:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098728448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483173.078136:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098728576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483173.078180:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483173.078211:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788483173.078483:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728576 00000100:00100000:2.0:1788483173.078487:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728576 00000100:00100000:2.0:1788483173.078510:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788483173.078517:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17201:x1875360098728576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483173.078613:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17201:x1875360098728576:12345-0@lo:503:mount.lustre.0 Request processed in 95us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483173.078619:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788483173.078692:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098728576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483173.079611:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17254:1875360098728704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483173.079663:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483173.079700:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.079741:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728704 00000100:00100000:3.0:1788483173.079747:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728704 00000100:00100000:3.0:1788483173.079773:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788483173.079779:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17254:x1875360098728704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.079876:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17254:x1875360098728704:12345-0@lo:502:llog_process_th.0 Request processed in 97us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483173.079883:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788483173.079964:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17254:1875360098728704:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788483173.080017:0:17254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788483173.080031:0:17254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a69edaa19b8) 00000020:00000080:2.0:1788483173.080051:0:17254:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788483173.080175:0:17254:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69ece13000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788483173.080180:0:17254:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69ece13000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788483173.080182:0:17254:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69ece13000 4 00010000:00080000:2.0:1788483173.080210:0:17254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69c626f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483173.081814:0:17254:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788483173.082042:0:17254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788483173.082082:0:17254:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788483173.082119:0:17254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1d7ea3d89ea1b73c 00000100:00080000:2.0:1788483173.082129:0:17254:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483173.082135:0:17254:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a69c626f000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483173.082167:0:17254:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd934a80 x1875360098728832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483173.082193:0:17254:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788483173.082501:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098728832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483173.082574:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483173.083291:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728832 00000100:00100000:3.0:1788483173.083302:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728832 00000100:00100000:3.0:1788483173.083335:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483173.083343:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098728832:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483173.083401:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098728832:12345-0@lo:38:llog_process_th.0 Request processed in 58us (826us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788483173.083408:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483173.083444:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483173.083450:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c626f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483173.083454:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788483173.083457:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098728832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483173.093954:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17254:1875360098728960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.094033:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483173.094084:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.094126:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098728960 00000100:00100000:3.0:1788483173.094141:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098728960 00000100:00100000:3.0:1788483173.094200:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788483173.094209:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17254:x1875360098728960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.094544:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17254:x1875360098728960:12345-0@lo:502:llog_process_th.0 Request processed in 334us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483173.094551:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788483173.094599:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17254:1875360098728960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.094637:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17254:1875360098729088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.094665:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483173.094684:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df3776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.094694:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729088 00000100:00100000:3.0:1788483173.094697:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729088 00000100:00100000:3.0:1788483173.094717:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483173.094722:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17254:x1875360098729088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483173.094775:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17254:x1875360098729088:12345-0@lo:502:llog_process_th.0 Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483173.094782:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483173.094811:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4be19e4a-e21c-409c-93a6-e1423c5e2099:17254:1875360098729088:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788483173.094827:0:17254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788483173.094922:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788483173.094942:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788483173.094954:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483173.094965:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788483173.095010:0:17201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788483173.095011:0:17201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483173.095013:0:17201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483173.095014:0:17201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483173.095016:0:17201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483173.095017:0:17201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483173.095018:0:17201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483173.095020:0:17201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483173.095021:0:17201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483173.095023:0:17201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788483173.095026:0:17201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788483173.095028:0:17201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483173.095029:0:17201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483173.095030:0:17201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483173.095031:0:17201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483173.095032:0:17201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483173.095033:0:17201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483173.095034:0:17201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483173.095035:0:17201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483173.095036:0:17201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483173.095037:0:17201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788483173.095047:0:17201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788483173.095067:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098729216:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483173.095093:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483173.095132:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df3776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483173.095144:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729216 00000100:00100000:3.0:1788483173.095148:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729216 00000100:00100000:3.0:1788483173.095162:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788483173.095167:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17201:x1875360098729216:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788483173.095183:0:17217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788483173.095192:0:17217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788483173.107702:0:17217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788483173.107753:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788483173.108159:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17201:x1875360098729216:12345-0@lo:253:mount.lustre.0 Request processed in 12987us (13061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483173.108184:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788483173.108257:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17201:1875360098729216:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788483173.108281:0:17201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788483173.108284:0:17201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788483173.108286:0:17201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483173.108287:0:17201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483173.108288:0:17201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483173.108289:0:17201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483173.108291:0:17201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483173.108292:0:17201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483173.108294:0:17201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483173.108296:0:17201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483173.108297:0:17201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788483173.108311:0:17201:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788483173.123247:0:17238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788483173.123256:0:17238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788483173.123926:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.124143:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 11 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.124153:0:17238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.129187:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 11 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483173.134754:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 11 pid: 17216 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483173.134777:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098729344:0@lo:104: 00000100:00100000:2.0:1788483173.134865:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483173.134908:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c342c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483173.136474:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729344 00000100:00100000:0.0:1788483173.136482:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729344 00000100:00100000:0.0:1788483173.136526:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483173.136536:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098729344:12345-0@lo:104: 00010000:00010000:0.0:1788483173.136551:0:17205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.136626:0:17205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788483173.136632:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098729344:12345-0@lo:104: Request processed in 99us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483173.136639:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788483173.136659:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483173.136672:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.136680:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483173.136684:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.136692:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483173.136699:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483173.136705:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788483173.136723:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098729344:0@lo:104: 00010000:00010000:0.0:1788483173.136734:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.136740:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483173.136742:0:17238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.137996:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138009:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27a00/0x1d7ea3d89ea1b70b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b712 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138034:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483173.138036:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483173.138038:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483173.138139:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098729472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483173.138189:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483173.138609:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729472 00000100:00100000:0.0:1788483173.138616:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729472 00010000:00010000:0.0:1788483173.138642:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 12 pid: 17216 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483173.138726:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483173.138735:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:3619:x1875360098729472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483173.138747:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483173.138753:0:17207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 12 pid: 17216 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138776:0:17207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 12 pid: 17216 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138792:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76400/0x1d7ea3d89ea1b712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b70b expref: 12 pid: 17216 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138805:0:17207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138813:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788483173.138827:0:17207:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015572219s 00010000:00010000:0.0:1788483173.138831:0:17207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138839:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138845:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138851:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138863:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483173.138867:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138874:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138898:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483173.138908:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483173.139083:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:3619:x1875360098729472:12345-0@lo:103:ldlm_bl.0 Request processed in 349us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483173.139090:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788483173.139492:0:17238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483173.139501:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483173.139506:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77200/0x1d7ea3d89ea1b743 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483173.146189:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098729472:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788483173.163063:0:17201:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788483173.163622:0:17201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788483173.163701:0:17262:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788483173.163705:0:17262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788483173.164206:0:17263:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788483173.164912:0:17263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483173.166915:0:17263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788483173.166990:0:17263:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1788483173.168323:0:17201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1788483173.170730:0:17264:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a69c59e4380 x1875360098729600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483173.170744:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00000040:01000000:2.0:1788483173.171137:0:17201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788483173.171182:0:17201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788483173.171636:0:17201:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788483173.171643:0:17201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788483173.171674:0:17201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483173.172617:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788483173.173163:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788483173.173191:0:17201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788483173.185634:0:17201:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1788483173.189806:0:17201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788483173.196488:0:17201:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788483173.196525:0:17201:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb538418fb988 00100000:10000000:3.0:1788483173.196532:0:17201:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788483173.200885:0:17201:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788483173.200901:0:17201:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788483173.200920:0:17201:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788483173.200949:0:17201:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788483173.218317:0:17201:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483173.218548:0:17201:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788483173.688480:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483174.136897:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788483174.214553:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 10000000:01000000:2.0:1788483174.398037:0:17219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788483174.398045:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69ece13000 from 7 10000000:01000000:2.0:1788483174.398050:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788483174.398092:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483174.398138:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483174.398149:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483174.398171:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098729728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788483174.398341:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483174.398534:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729728 00000100:00100000:3.0:1788483174.398542:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729728 00000100:00100000:3.0:1788483174.398592:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788483174.398603:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+11:17219:x1875360098729728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483174.398615:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483174.398629:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b74a expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483174.398650:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 12 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483174.398660:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 12 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483174.398669:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3e00, rc 0) 00000100:00100000:3.0:1788483174.398709:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17219:x1875360098729728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483174.398716:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788483174.398818:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483174.398839:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098729728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483174.398852:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483174.398862:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483174.398914:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098729856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788483174.399570:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483174.399595:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483174.400349:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729856 00000100:00100000:3.0:1788483174.400357:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729856 00000100:00100000:3.0:1788483174.400417:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788483174.400426:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17219:x1875360098729856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788483174.400443:0:17217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788483174.400458:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788483174.400464:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788483174.400568:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17219:x1875360098729856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483174.400576:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788483174.402286:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098729856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788483174.402347:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788483174.402357:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483174.402365:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483174.721354:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483175.162572:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483175.231602:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788483175.748876:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483176.260386:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788483176.760389:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483177.284192:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788483177.786006:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483178.233500:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788483178.233507:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788483178.233510:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483178.233518:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1788483178.233524:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483178.233530:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69ed823000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483178.233551:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e4e00 x1875360098730112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483178.233571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483178.233575:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483178.233578:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483178.233580:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483178.233583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788483178.233586:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483178.233600:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69c626f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483178.233606:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a69c626f000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483178.233619:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e4a80 x1875360098730240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483178.233647:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098730112:0@lo:38:kworker.0 00000100:00100000:1.0:1788483178.233720:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483178.233766:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098730240:0@lo:38:kworker.0 00000100:00100000:1.0:1788483178.233793:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483178.233993:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483178.234004:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098729984:0@lo:400:kworker.0 00000100:00100000:2.0:1788483178.234038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483178.234091:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098730240 00000100:00100000:1.0:1788483178.234091:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729984 00000100:00100000:2.0:1788483178.234113:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098730240 00000100:00100000:1.0:1788483178.234113:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729984 00000100:00100000:1.0:1788483178.234144:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788483178.234152:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:3619:x1875360098729984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483178.234155:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483178.234159:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1875360098730240:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788483178.234185:0:17224:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000100:00100000:1.0:1788483178.234196:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:3619:x1875360098729984:12345-0@lo:400:kworker.0 Request processed in 45us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483178.234201:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:2.0:1788483178.234216:0:17224:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1d7ea3d89ea1b758 00000004:00100000:2.0:1788483178.234229:0:17224:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788483178.234378:0:17224:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483178.234428:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875360098730240:12345-0@lo:38:kworker.0 Request processed in 266us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483178.234434:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483178.234472:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098729984:0@lo:400:kworker.0 00000100:00100000:2.0:1788483178.234515:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098730112 00000100:00100000:2.0:1788483178.234519:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098730112 00000100:00100000:2.0:1788483178.234539:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483178.234544:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098730112:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788483178.234554:0:17228:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788483178.235130:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a69c59e4a80 x1875360098730240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483178.235145:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788483178.235152:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788483178.235157:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788483178.235159:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c626f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483178.235165:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098730240:0@lo:38:kworker.0 00000100:00100000:0.0:1788483178.263581:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098730112:12345-0@lo:38:kworker.0 Request processed in 29029us (29855us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483178.263600:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788483178.263655:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483178.263660:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483178.263664:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098730112:0@lo:38:kworker.0 00000100:00100000:1.0:1788483178.299732:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00000001:02000400:2.0:1788483178.366088:0:17506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788483178.809313:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483179.320170:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788483179.832824:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788483179.891439:0:17559:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788483179.891940:0:17559:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788483180.344340:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788483180.858160:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788483181.090280:0:17609:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483181.090468:0:17609:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788483181.368513:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788483181.883127:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483182.328498:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483172/real 1788483172] req@ffff9a68c35f9880 x1875360098727040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483182 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483182.328537:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a68c35f9880 x1875360098727040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483182 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788483182.328556:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483182.328578:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788483182.328583:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098727040:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788483182.328671:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788483182.328682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788483182.328694:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483182.328700:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1788483182.328705:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483182.328711:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69ed823000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483182.328731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e4000 x1875360098730496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483182.328749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483182.328752:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788483182.328754:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483182.328757:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1788483182.328759:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483182.328761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a69d18c9800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483182.328773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e5500 x1875360098730624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483182.328781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483182.328784:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483182.328813:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098730496:0@lo:38:kworker.0 00000100:00100000:1.0:1788483182.328872:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483182.328924:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098730624:0@lo:8:kworker.0 00000400:00000100:1.0:1788483182.328948:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098730624 offset 0 length 520: 4 00000100:00100000:2.0:1788483182.328975:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098730752:0@lo:400:kworker.0 00000100:00100000:1.0:1788483182.328983:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098730496 00000100:00100000:1.0:1788483182.328991:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098730496 00000100:00100000:2.0:1788483182.329017:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483182.329032:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483182.329044:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483182.329049:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098730496:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788483182.329054:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4be19e4a-e21c-409c-93a6-e1423c5e2099:3622:1875360098730368:0@lo:400:kworker.0 00010000:00020000:1.0:1788483182.329073:0:17227:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788483182.329089:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483182.329151:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098730368 00000100:00100000:2.0:1788483182.329155:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098730368 00000100:00100000:2.0:1788483182.329189:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788483182.329196:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:3622:x1875360098730368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483182.329250:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:3622:x1875360098730368:12345-0@lo:400:kworker.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483182.329257:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788483182.329300:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4be19e4a-e21c-409c-93a6-e1423c5e2099:3622:1875360098730368:0@lo:400:kworker.0 00000100:00100000:0.0:1788483182.332265:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098730752 00000100:00100000:0.0:1788483182.332282:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098730752 00000100:00100000:0.0:1788483182.332361:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483182.332371:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098730752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483182.332466:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098730752:12345-0@lo:400:kworker.0 Request processed in 97us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483182.332473:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788483182.333172:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a69c59e5180 x1875360098730752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483182.333188:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098730752:0@lo:400:kworker.0 00000100:00100000:1.0:1788483182.348439:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098730496:12345-0@lo:38:kworker.0 Request processed in 19383us (19558us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483182.348455:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788483182.352030:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483182.352041:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483182.352048:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098730496:0@lo:38:kworker.0 00000100:00100000:3.0:1788483182.392210:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788483182.905285:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483183.359923:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483173/real 1788483173] req@ffff9a68c35f8e00 x1875360098727168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483183.359951:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a68c35f8e00 x1875360098727168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483183.359969:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483183.359991:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788483183.359995:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098727168:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788483183.360965:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788483183.360970:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788483183.360974:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483183.360979:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:3.0:1788483183.360984:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788483183.360990:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69ed823000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483183.361009:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35fa300 x1875360098731008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483183.361023:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483183.361027:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483183.361029:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483183.361032:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788483183.361033:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483183.361036:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:3.0:1788483183.361038:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788483183.361041:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69efd93800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483183.361048:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35f9f80 x1875360098731136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483183.361207:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098731008:0@lo:38:kworker.0 00000100:00100000:1.0:1788483183.361273:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483183.361315:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098731136:0@lo:8:kworker.0 00000400:00000100:1.0:1788483183.361470:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098731136 offset 0 length 520: 4 00000100:00100000:3.0:1788483183.361541:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098731008 00000100:00100000:3.0:1788483183.361548:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098731008 00000100:00100000:3.0:1788483183.361580:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483183.361587:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098731008:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788483183.361602:0:17228:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788483183.361638:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098731008:12345-0@lo:38:kworker.0 Request processed in 50us (365us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483183.361645:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483183.361716:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098730880:0@lo:400:kworker.0 00000100:00080000:1.0:1788483183.361907:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483183.361912:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788483183.361915:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098731008:0@lo:38:kworker.0 00000100:00100000:2.0:1788483183.361971:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483183.362025:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483183.362031:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098731264:0@lo:400:kworker.0 00000100:00100000:2.0:1788483183.362055:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483183.364013:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098731264 00000100:00100000:3.0:1788483183.364023:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098731264 00000100:00100000:3.0:1788483183.364072:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483183.364091:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098731264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483183.364173:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098731264:12345-0@lo:400:kworker.0 Request processed in 93us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483183.364180:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788483183.364770:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a68c35f9c00 x1875360098731264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483183.364786:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098731264:0@lo:400:kworker.0 00000100:00100000:1.0:1788483183.367318:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098730880 00000100:00100000:1.0:1788483183.367334:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098730880 00000100:00100000:0.0:1788483183.367517:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788483183.367527:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:3619:x1875360098730880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483183.367648:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:3619:x1875360098730880:12345-0@lo:400:kworker.0 Request processed in 122us (5676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483183.367655:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788483183.370317:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098730880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483183.416161:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788483183.939818:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483184.440429:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788483184.952725:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483185.401448:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788483185.465318:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788483185.976635:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483186.491177:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788483187.002208:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483187.513709:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00000020:01000004:0.0:1788483187.752512:0:17954:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788483187.752516:0:17954:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788483187.752517:0:17954:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788483187.752626:0:17954:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a68c3dba000 00000020:01000004:0.0:1788483187.752640:0:17954:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788483187.752651:0:17954:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788483187.752665:0:17954:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a68c24e3370) 00000020:00000080:0.0:1788483187.752679:0:17954:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788483187.805684:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.807401:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788483187.809294:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788483187.809840:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788483187.810265:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788483187.810546:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788483187.810772:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788483187.811028:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788483187.811401:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788483187.811584:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788483187.811798:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788483187.812039:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788483187.812429:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788483187.812673:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788483187.814855:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.815588:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.815786:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.816217:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.816558:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.816741:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.817041:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.817511:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.817722:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.818022:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.818428:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.818666:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.818903:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.819351:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.819669:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.819903:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.820172:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.820501:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.820759:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.821023:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.821368:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.821742:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.821996:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.822310:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.822582:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.822896:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.823272:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788483187.823601:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.823785:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.824011:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.824532:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788483187.824724:0:17954:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00080000:01000000:3.0:1788483187.826533:0:17954:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788483187.826768:0:17954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788483187.826779:0:17954:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483187.826790:0:17954:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1b766 00000020:01000004:3.0:1788483187.826797:0:17954:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788483187.826816:0:17954:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788483187.826825:0:17954:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788483187.826831:0:17954:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788483187.826858:0:17954:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788483187.826863:0:17954:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788483187.833278:0:17954:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788483187.833397:0:17954:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.154@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788483187.833402:0:17954:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788483187.833403:0:17954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788483187.833405:0:17954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483187.833406:0:17954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483187.833407:0:17954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483187.833408:0:17954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483187.833410:0:17954:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483187.833411:0:17954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483187.833413:0:17954:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483187.833416:0:17954:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788483187.833419:0:17954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483187.833420:0:17954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788483187.833421:0:17954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483187.833422:0:17954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483187.833423:0:17954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483187.833424:0:17954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483187.833425:0:17954:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483187.833426:0:17954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483187.833427:0:17954:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483187.833453:0:17954:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788483187.833472:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731392:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483187.833539:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.833642:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483187.833726:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098731392 00000100:00100000:2.0:1788483187.833733:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098731392 00000100:00100000:2.0:1788483187.833824:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788483187.833833:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17954:x1875360098731392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483187.833860:0:17215:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788483187.833869:0:17215:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788483187.833876:0:17215:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788483187.834201:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17954:x1875360098731392:12345-0@lo:253:mount.lustre.0 Request processed in 360us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.834210:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788483187.834294:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731392:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788483187.834303:0:17954:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788483187.834306:0:17954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788483187.834307:0:17954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788483187.834309:0:17954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483187.834310:0:17954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483187.834330:0:17954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483187.834331:0:17954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483187.834332:0:17954:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483187.834333:0:17954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483187.834334:0:17954:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788483187.834350:0:17954:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a68c3dba000 from lustre-MDT0001 10000000:01000000:3.0:1788483187.834376:0:17954:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788483187.834378:0:17954:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788483187.834384:0:17954:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69edaa0000 local copy 00010000:00010000:3.0:1788483187.834392:0:17954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483187.834465:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483187.834493:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.834806:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483187.834877:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098731520 00000100:00100000:0.0:1788483187.834883:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098731520 00000100:00100000:0.0:1788483187.834911:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788483187.834918:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17954:x1875360098731520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483187.835027:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17954:x1875360098731520:12345-0@lo:501:mount.lustre.0 Request processed in 109us (533us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788483187.835034:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483187.835428:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731520:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788483187.835446:0:17954:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788483187.835466:0:17954:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788483187.835473:0:17954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.835481:0:17954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483187.835507:0:17954:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a68c3dba000 10000000:01000000:3.0:1788483187.835512:0:17954:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788483187.835516:0:17954:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a69edaa0000 10000000:01000000:3.0:1788483187.835519:0:17954:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788483187.835522:0:17954:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a69edaa0000 from 1 10000000:01000000:3.0:1788483187.835525:0:17954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788483187.835548:0:17954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.835564:0:17954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.835574:0:17954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483187.835589:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483187.835618:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.835643:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483187.835695:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098731648 00000100:00100000:0.0:1788483187.835705:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098731648 00000100:00100000:0.0:1788483187.835737:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788483187.835745:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+12:17954:x1875360098731648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483187.835754:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483187.835765:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b774 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b76d expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.835784:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b774 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b76d expref: 13 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.835793:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b774 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b76d expref: 13 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.835801:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8800, rc 0) 00000100:00100000:0.0:1788483187.835839:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+13:17954:x1875360098731648:12345-0@lo:101:mount.lustre.0 Request processed in 95us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483187.835846:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788483187.835916:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483187.835928:0:17954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b774 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.835937:0:17954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b774 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483187.835952:0:17954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788483187.835967:0:17954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b774 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.835974:0:17954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b774 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483187.835982:0:17954:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a68c3dba000 10000000:01000000:3.0:1788483187.835986:0:17954:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788483187.835989:0:17954:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a68c3dba000 from 1 10000000:01000000:3.0:1788483187.835991:0:17954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788483187.836011:0:17954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.836018:0:17954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.836025:0:17954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483187.836037:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483187.836061:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.836073:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483187.836147:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098731776 00000100:00100000:2.0:1788483187.836151:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098731776 00000100:00100000:2.0:1788483187.836297:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788483187.836305:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+13:17954:x1875360098731776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483187.836393:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483187.836403:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1b782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b77b expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.836418:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1b782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b77b expref: 14 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.836427:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1b782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b77b expref: 14 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.836434:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76000, rc 0) 00000100:00100000:2.0:1788483187.836474:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+14:17954:x1875360098731776:12345-0@lo:101:mount.lustre.0 Request processed in 171us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.836480:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788483187.836544:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483187.836555:0:17954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.836562:0:17954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483187.836573:0:17954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788483187.836577:0:17954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.836583:0:17954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483187.836588:0:17954:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788483187.836592:0:17954:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483187.836597:0:17954:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a68c3dba000 10000000:01000000:3.0:1788483187.836606:0:17954:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788483187.836610:0:17954:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788483187.836611:0:17954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788483187.836625:0:17954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.836632:0:17954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.836639:0:17954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483187.836651:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483187.836677:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.836704:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483187.836759:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098731904 00000100:00100000:0.0:1788483187.836763:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098731904 00000100:00100000:0.0:1788483187.836782:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788483187.836787:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+14:17954:x1875360098731904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483187.836793:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483187.836801:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b789 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.836815:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b789 expref: 15 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.836823:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b789 expref: 15 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.836836:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8600, rc 0) 00000100:00100000:0.0:1788483187.836870:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098731904:12345-0@lo:101:mount.lustre.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483187.836877:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788483187.836943:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098731904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483187.836954:0:17954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.836961:0:17954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483187.838125:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788483187.838867:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483187.844981:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788483187.845036:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788483187.845053:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788483187.845065:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788483187.845076:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788483187.845087:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788483187.845183:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788483187.845209:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788483187.845223:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788483187.845234:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788483187.845245:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788483187.845258:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788483187.845272:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788483187.845282:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788483187.845294:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788483187.845306:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788483187.845447:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788483187.845462:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788483187.845474:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788483187.845488:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788483187.845501:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788483187.845513:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788483187.845524:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788483187.845550:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788483187.845556:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788483187.845650:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483187.845713:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.845758:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483187.845836:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098732032 00000100:00100000:0.0:1788483187.845844:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098732032 00000100:00100000:0.0:1788483187.845932:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788483187.845942:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483187.846143:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732032:12345-0@lo:501:mount.lustre.0 Request processed in 201us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483187.846152:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788483187.846253:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483187.846284:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483187.846625:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.846785:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629300 going to sleep for 11 seconds 00000100:00100000:2.0:1788483187.846848:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098732160 00000100:00100000:2.0:1788483187.846854:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098732160 00000100:00100000:2.0:1788483187.846879:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788483187.846886:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483187.847760:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732160:12345-0@lo:503:mount.lustre.0 Request processed in 871us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.847779:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788483187.847973:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788483187.848710:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483187.848790:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483187.848834:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.848870:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483187.848931:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098732288 00000100:00100000:2.0:1788483187.848937:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098732288 00000100:00100000:2.0:1788483187.848976:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788483187.848985:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483187.849886:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732288:12345-0@lo:502:mount.lustre.0 Request processed in 900us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.849896:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788483187.849981:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483187.850224:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788483187.850251:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788483187.850264:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788483187.850275:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788483187.850287:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788483187.850298:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788483187.850309:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788483187.850556:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788483187.850571:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788483187.850583:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788483187.850606:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788483187.850621:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788483187.850635:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788483187.850648:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788483187.850659:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788483187.850674:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788483187.850688:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788483187.850700:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788483187.850712:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788483187.850723:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788483187.850734:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788483187.850746:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788483187.850760:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788483187.850773:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788483187.850787:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788483187.850800:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788483187.850812:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788483187.850822:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788483187.850833:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788483187.850846:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788483187.850860:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788483187.850872:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788483187.850885:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788483187.850899:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788483187.850912:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788483187.850925:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788483187.850939:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788483187.850953:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788483187.850965:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788483187.850977:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788483187.850991:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788483187.851006:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788483187.851020:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788483187.851045:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788483187.851077:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483187.851294:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.851453:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483187.851604:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098732416 00000100:00100000:0.0:1788483187.851611:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098732416 00000100:00100000:2.0:1788483187.851665:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788483187.851675:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483187.851793:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098732416:12345-0@lo:502:mount.lustre.0 Request processed in 120us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.851802:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788483187.852298:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098732416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483187.852428:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788483187.852438:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788483187.853179:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483187.853190:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.853208:0:17958:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788483187.853215:0:17958:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788483187.853218:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483187.853233:0:17958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a69d287cd28) 00000020:00000080:3.0:1788483187.853254:0:17958:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788483187.853261:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788483187.853354:0:17958:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788483187.853361:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1b79e 00000020:00000080:3.0:1788483187.853611:0:17958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788483187.853616:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483187.853620:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.853622:0:17958:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788483187.853625:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483187.853629:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.853630:0:17958:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788483187.853633:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483187.853641:0:17958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a69d2878000) 00000020:00000080:3.0:1788483187.853652:0:17958:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788483187.853655:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788483187.853657:0:17958:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788483187.853660:0:17958:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788483187.853667:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788483187.853715:0:17958:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c3dba000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788483187.853728:0:17958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a69d287b370) 00000020:00000080:3.0:1788483187.853737:0:17958:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788483187.853793:0:17958:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788483187.853798:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1b7b3 00000020:00000080:3.0:1788483187.853879:0:17958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788483187.853884:0:17958:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788483187.853888:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1d7ea3d89ea1b7ba 00080000:01000000:3.0:1788483187.853894:0:17958:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788483187.853897:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1b7c1 00010000:00010000:3.0:1788483187.935678:0:17958:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788483187.936159:0:17958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788483187.936605:0:17958:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788483187.943851:0:17958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788483187.943864:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483187.943871:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.943873:0:17958:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788483187.943877:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483187.943883:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.943885:0:17958:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788483187.943888:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788483187.943893:0:17958:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:00000080:2.0:1788483187.943922:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483187.943938:0:17958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a69edaa3370) 00000020:00000080:2.0:1788483187.943959:0:17958:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788483187.943965:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788483187.944057:0:17958:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788483187.944064:0:17958:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788483187.944078:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1b7cf 00010000:00080000:2.0:1788483187.944144:0:17958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69ece27000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483187.945850:0:17958:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788483187.947404:0:17958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788483187.947418:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788483187.947468:0:17958:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788483187.947489:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1b7d6 00000100:00080000:3.0:1788483187.947499:0:17958:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788483187.947503:0:17958:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a69ece27000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483187.947537:0:17958:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35f8380 x1875360098732544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483187.947557:0:17958:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788483187.947655:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483187.947659:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.947661:0:17958:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788483187.947664:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788483187.947666:0:17958:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788483187.947667:0:17958:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483187.947669:0:17958:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483187.947670:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788483187.947672:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.947673:0:17958:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788483187.947676:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483187.947680:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.947681:0:17958:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788483187.947685:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788483187.947713:0:17958:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788483187.947725:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483187.947728:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.947729:0:17958:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788483187.947732:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788483187.947733:0:17958:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788483187.947740:0:17958:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483187.947742:0:17958:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788483187.947744:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788483187.947747:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.947748:0:17958:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788483187.947750:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788483187.947753:0:17958:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788483187.947756:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.947757:0:17958:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788483187.947760:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788483187.947764:0:17958:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:3.0:1788483187.947785:0:17958:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788483187.947788:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483187.947799:0:17958:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a69d28799b8) 00000020:00000080:3.0:1788483187.947811:0:17958:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788483187.947816:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788483187.947868:0:17958:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788483187.947874:0:17958:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788483187.947879:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1b7e4 00010000:00080000:3.0:1788483187.947906:0:17958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69d25dc000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:3.0:1788483187.948127:0:17958:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788483187.948276:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098732544:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483187.948350:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.948518:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098732544 00000100:00100000:3.0:1788483187.948526:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098732544 00000100:00100000:3.0:1788483187.948560:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483187.948567:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098732544:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788483187.948589:0:17228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1788483187.948620:0:17228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1b7eb 00000004:00100000:3.0:1788483187.948634:0:17228:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788483187.948640:0:17228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:3.0:1788483187.949806:0:17958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1788483187.950021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788483187.950026:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788483187.950029:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483187.950036:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:0.0:1788483187.950039:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788483187.950045:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69ed823000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483187.950075:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c5419f80 x1875360098732672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483187.950139:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098732672:0@lo:38:kworker.0 00000100:00100000:1.0:1788483187.950208:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483187.950343:0:17227:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788483187.950352:0:17227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:3.0:1788483187.950504:0:17958:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788483187.950620:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483187.950625:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483187.950628:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483187.950631:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483187.950884:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483187.950898:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098732800:0@lo:400:kworker.0 00000100:00100000:3.0:1788483187.950934:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483187.950985:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098732672 00000100:00100000:3.0:1788483187.950991:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098732672 00000100:00100000:3.0:1788483187.951154:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483187.951162:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098732672:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788483187.951715:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098732800 00000100:00100000:0.0:1788483187.951721:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098732800 00000100:00100000:0.0:1788483187.951758:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788483187.951766:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098732800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483187.951822:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098732800:12345-0@lo:400:kworker.0 Request processed in 57us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483187.951828:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788483187.951885:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a69c5419880 x1875360098732800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483187.951898:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098732800:0@lo:400:kworker.0 00000100:00100000:3.0:1788483187.953623:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098732672:12345-0@lo:38:kworker.0 Request processed in 2456us (3410us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788483187.953634:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1788483187.953849:0:17958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483187.954130:0:17958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788483187.954298:0:17958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788483187.954792:0:17964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788483187.954796:0:17964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788483187.956466:0:17958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788483187.956479:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788483187.956522:0:17958:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788483187.956544:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1b7f2 00000100:00080000:2.0:1788483187.956554:0:17958:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483187.956560:0:17958:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a69d25dc000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483187.956594:0:17958:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd934700 x1875360098732928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483187.956611:0:17958:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788483187.956857:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483187.956862:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.956864:0:17958:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788483187.956868:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788483187.956870:0:17958:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788483187.956872:0:17958:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483187.956873:0:17958:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483187.956875:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788483187.956877:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.956879:0:17958:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788483187.956881:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788483187.956885:0:17958:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788483187.956888:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.956897:0:17958:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788483187.956901:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788483187.956905:0:17958:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:2.0:1788483187.956928:0:17958:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788483187.956931:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483187.956952:0:17958:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a69c76d0000) 00000020:00000080:2.0:1788483187.956966:0:17958:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788483187.956972:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788483187.957039:0:17958:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788483187.957045:0:17958:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788483187.957051:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1b800 00010000:00080000:2.0:1788483187.957077:0:17958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69c2b8d000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483187.957387:0:17958:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788483187.957456:0:17958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788483187.957472:0:17958:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788483187.958390:0:17228:0:(import.c:65:import_set_state_nolock()) ffff9a68c1c41000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483187.958470:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098732544:12345-0@lo:38:llog_process_th.0 Request processed in 9900us (10118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.958479:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788483187.959548:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788483187.959557:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483187.959562:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788483187.959566:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098732672:0@lo:38:kworker.0 00000100:00100000:1.0:1788483187.959580:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788483187.959586:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788483187.959593:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788483187.959598:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788483187.959601:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483187.959615:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098732544:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483187.959644:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098732928:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788483187.959685:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098732928 offset 0 length 520: 4 00000100:00100000:0.0:1788483187.959831:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483187.959841:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098733056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483187.959878:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788483187.960583:0:17958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483187.960882:0:17958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000100:00100000:3.0:1788483187.961510:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098733056 00000100:00100000:3.0:1788483187.961519:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098733056 00000100:00100000:3.0:1788483187.961574:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483187.961585:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875360098733056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483187.961616:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788483187.961682:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875360098733056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483187.961689:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788483187.961711:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483187.961716:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483187.961719:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483187.961721:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483187.961917:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098733056:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788483187.962120:0:17958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788483187.962624:0:17966:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788483187.962629:0:17966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788483187.963524:0:17958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788483187.963536:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788483187.963575:0:17958:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788483187.963596:0:17958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1b807 00000100:00080000:2.0:1788483187.963605:0:17958:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483187.963610:0:17958:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69c2b8d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483187.963643:0:17958:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd934380 x1875360098733184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483187.963686:0:17958:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788483187.963743:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098733184:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788483187.963793:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098733184 offset 0 length 520: 4 00000020:01000000:2.0:1788483187.964239:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483187.964245:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.964246:0:17958:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788483187.964250:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483187.964253:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.964255:0:17958:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788483187.964258:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788483187.964259:0:17958:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788483187.964261:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483187.964264:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.964265:0:17958:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788483187.964267:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483187.964269:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.964270:0:17958:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788483187.964273:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788483187.964299:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483187.964302:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483187.964303:0:17958:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788483187.964306:0:17958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1788483187.964644:0:17954:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788483187.964676:0:17954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788483187.964700:0:17954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.964711:0:17954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483187.964720:0:17954:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c3dba000 from 1 10000000:01000000:1.0:1788483187.964722:0:17954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483187.964750:0:17954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.964758:0:17954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.964769:0:17954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483187.964787:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483187.964830:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483187.964855:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788483187.964913:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098733312 00000100:00100000:2.0:1788483187.964919:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098733312 00000100:00100000:2.0:1788483187.965006:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788483187.965016:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+15:17954:x1875360098733312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483187.965027:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483187.965038:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b80e expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.965059:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 16 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.965085:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 16 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.965114:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76c00, rc 0) 00000100:00100000:2.0:1788483187.965156:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:17954:x1875360098733312:12345-0@lo:101:mount.lustre.0 Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.965175:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788483187.965328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483187.965333:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483187.965336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483187.965344:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483187.965603:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483187.965619:0:17954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.965629:0:17954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483187.966711:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733440:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788483187.966773:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.966850:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788483187.966892:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098733440 00000100:00100000:2.0:1788483187.966899:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098733440 00000100:00100000:2.0:1788483187.967053:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788483187.967064:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:17954:x1875360098733440:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788483187.967084:0:17216:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788483187.967131:0:17216:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788483187.967135:0:17216:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788483187.967238:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:17954:x1875360098733440:12345-0@lo:256:mount.lustre.0 Request processed in 176us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.967245:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788483187.967331:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733440:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788483187.967902:0:17954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483187.967925:0:17954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.968182:0:17954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483187.968190:0:17954:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c3dba000 from 1 10000000:01000000:0.0:1788483187.968202:0:17954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788483187.968230:0:17954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.968239:0:17954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.968248:0:17954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483187.968276:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483187.968324:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.968678:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788483187.968726:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098733568 00000100:00100000:1.0:1788483187.968739:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098733568 00000100:00100000:2.0:1788483187.968787:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788483187.968798:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:17954:x1875360098733568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483187.968809:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483187.968821:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b81c expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.968842:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 17 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.968852:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 17 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483187.968867:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77000, rc 0) 00000100:00100000:2.0:1788483187.968914:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098733568:12345-0@lo:101:mount.lustre.0 Request processed in 117us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483187.968921:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788483187.968998:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483187.969011:0:17954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483187.969020:0:17954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483187.969206:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483187.969241:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483187.969268:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.969729:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483187.969805:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098733696 00000100:00100000:3.0:1788483187.969810:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098733696 00000100:00100000:3.0:1788483187.969838:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483187.969845:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098733696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483187.969949:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098733696:12345-0@lo:501:mount.lustre.0 Request processed in 104us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483187.969956:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788483187.970091:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483187.970147:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483187.970207:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.970229:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483187.970406:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098733824 00000100:00100000:1.0:1788483187.970411:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098733824 00000100:00100000:1.0:1788483187.970435:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788483187.970441:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098733824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483187.970518:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098733824:12345-0@lo:503:mount.lustre.0 Request processed in 77us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483187.970525:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788483187.970663:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733824:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788483187.971091:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483187.971457:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483187.971497:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.971560:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788483187.971589:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098733952 00000100:00100000:1.0:1788483187.971594:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098733952 00000100:00100000:1.0:1788483187.971652:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788483187.971660:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098733952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483187.971740:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098733952:12345-0@lo:502:mount.lustre.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483187.971747:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788483187.971804:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098733952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483187.971987:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788483187.972011:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788483187.972033:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788483187.972046:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788483187.972056:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788483187.972067:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788483187.972080:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788483187.972119:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788483187.972138:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788483187.972149:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788483187.972174:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788483187.972204:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483187.972235:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483187.972581:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788483187.972640:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734080 00000100:00100000:3.0:1788483187.972645:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734080 00000100:00100000:3.0:1788483187.972670:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788483187.972676:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098734080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483187.972765:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098734080:12345-0@lo:502:mount.lustre.0 Request processed in 88us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483187.972771:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788483187.972835:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483187.972874:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788483187.972882:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788483187.973600:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483187.973612:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973614:0:17968:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788483187.973620:0:17968:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c3dba000 00000020:00000080:3.0:1788483187.973622:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483187.973630:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483187.973632:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973634:0:17968:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788483187.973636:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483187.973638:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973639:0:17968:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788483187.973642:0:17968:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c3dba000 00000020:00000080:3.0:1788483187.973644:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483187.973700:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483187.973703:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973704:0:17968:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788483187.973706:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483187.973708:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973710:0:17968:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483187.973713:0:17968:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c3dba000 00000020:00000080:3.0:1788483187.973715:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483187.973729:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483187.973731:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973732:0:17968:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483187.973735:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483187.973737:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973738:0:17968:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788483187.973741:0:17968:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c3dba000 00000020:00000080:3.0:1788483187.973743:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483187.973760:0:17968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483187.973762:0:17968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483187.973763:0:17968:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788483187.973766:0:17968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788483187.978301:0:17954:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788483187.978363:0:17954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483187.978391:0:17954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.978404:0:17954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483187.978467:0:17954:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788483187.978470:0:17954:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a68c3dba000 10000000:01000000:1.0:1788483187.978473:0:17954:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a68c3dba000 10000000:01000000:1.0:1788483187.978477:0:17954:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788483187.978483:0:17954:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68c3dba000 from 1 10000000:01000000:1.0:1788483187.978486:0:17954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788483187.978528:0:17954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.978536:0:17954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.978547:0:17954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483187.978571:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483187.978649:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483187.978690:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483187.979303:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734208 00000100:00100000:3.0:1788483187.980008:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734208 00000100:00100000:3.0:1788483187.980068:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788483187.980079:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17954:x1875360098734208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483187.980092:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483187.980128:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1b831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b82a expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.980156:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1b831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b82a expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.980260:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1b831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b82a expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483187.980277:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2000, rc 0) 00000100:00100000:3.0:1788483187.980422:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734208:12345-0@lo:101:mount.lustre.0 Request processed in 344us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483187.980428:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483187.981189:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483187.981218:0:17954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483187.981228:0:17954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483187.982650:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788483187.982898:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483187.984653:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788483187.984685:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1788483187.984699:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1788483187.984712:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1788483187.984725:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1788483187.984742:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1788483187.984755:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1788483187.984768:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1788483187.984781:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1788483187.984807:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1788483187.984821:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1788483187.984833:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1788483187.984845:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1788483187.984857:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1788483187.984870:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1788483187.984881:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1788483187.984895:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1788483187.984921:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1788483187.986630:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1788483187.986670:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1788483187.986687:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1788483187.986702:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1788483187.986716:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1788483187.986735:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1788483187.986746:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1788483187.986757:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1788483187.986768:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1788483187.986777:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1788483187.986800:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1788483187.986805:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788483187.986908:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483187.987787:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483187.987832:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483187.988423:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734336 00000100:00100000:3.0:1788483187.988432:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734336 00000100:00100000:3.0:1788483187.988483:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788483187.988492:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483187.988624:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734336:12345-0@lo:501:mount.lustre.0 Request processed in 133us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483187.988632:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483187.989062:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483187.989126:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483187.990022:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483187.990065:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483187.991482:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734464 00000100:00100000:3.0:1788483187.991495:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734464 00000100:00100000:3.0:1788483187.991552:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788483187.991562:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483187.991702:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734464:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483187.991709:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483187.992264:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734464:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788483187.992682:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788483187.992752:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483187.992801:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483187.997419:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483187.997421:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734592 00000100:00100000:0.0:1788483187.997433:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734592 00000100:00100000:0.0:1788483187.997489:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788483187.997500:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483187.997661:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734592:12345-0@lo:502:mount.lustre.0 Request processed in 163us (4859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483187.997669:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788483187.999801:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483188.001487:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788483188.001537:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788483188.001567:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788483188.001580:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788483188.001592:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788483188.001606:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788483188.001618:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788483188.001630:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788483188.001644:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788483188.001655:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788483188.001667:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788483188.001681:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788483188.001694:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788483188.001707:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788483188.001720:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788483188.001731:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788483188.001744:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788483188.001758:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788483188.001784:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788483188.001799:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788483188.001812:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788483188.001825:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788483188.001838:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788483188.001851:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788483188.001864:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788483188.001887:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788483188.001900:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788483188.001912:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788483188.001924:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788483188.003080:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788483188.003122:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788483188.003136:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788483188.003150:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788483188.003248:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788483188.003284:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788483188.003299:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788483188.003384:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788483188.003408:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788483188.003421:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788483188.003434:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788483188.003447:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788483188.003460:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788483188.003472:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788483188.003485:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788483188.003497:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788483188.003510:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788483188.003523:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788483188.003536:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788483188.003590:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483188.003668:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483188.003710:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483188.004042:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734720 00000100:00100000:3.0:1788483188.004049:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734720 00000100:00100000:3.0:1788483188.004111:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788483188.004121:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483188.004838:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734720:12345-0@lo:502:mount.lustre.0 Request processed in 716us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483188.004848:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788483188.005065:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483188.006427:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788483188.006471:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788483188.006511:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483188.006571:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483188.006606:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483188.007190:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734848 00000100:00100000:0.0:1788483188.007208:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734848 00000100:00100000:0.0:1788483188.007260:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788483188.007270:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483188.007404:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098734848:12345-0@lo:502:mount.lustre.0 Request processed in 135us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483188.007412:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788483188.008043:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098734848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483188.008257:0:17954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788483188.008269:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788483188.008927:0:17974:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788483188.009026:0:17974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a69d0463370) 00000020:00000080:3.0:1788483188.009046:0:17974:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788483188.009412:0:17974:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c3dba000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788483188.009417:0:17974:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c3dba000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788483188.009419:0:17974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c3dba000 3 00010000:00080000:3.0:1788483188.009449:0:17974:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c24ee800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:3.0:1788483188.012049:0:17974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788483188.012447:0:17974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788483188.012490:0:17974:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788483188.012504:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1d7ea3d89ea1b83f 00000100:00080000:3.0:1788483188.012513:0:17974:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788483188.012519:0:17974:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a68c24ee800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483188.012552:0:17974:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35fa680 x1875360098734976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483188.012582:0:17974:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788483188.012607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483188.012612:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483188.012615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483188.012617:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788483188.012848:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098734976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788483188.012910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.013059:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098734976 00000100:00100000:3.0:1788483188.013066:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098734976 00000100:00100000:3.0:1788483188.013126:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483188.013133:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098734976:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788483188.013153:0:17222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1788483188.013383:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1d7ea3d89ea1b846 00000004:00100000:3.0:1788483188.013401:0:17222:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788483188.013428:0:17222:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ed000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483188.013485:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875360098734976:12345-0@lo:38:llog_process_th.0 Request processed in 350us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483188.013492:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788483188.013569:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a68c35fa680 x1875360098734976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483188.013579:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788483188.013587:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788483188.013593:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788483188.013597:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788483188.013599:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788483188.013604:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098734976:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788483188.015610:0:17974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788483188.015881:0:17954:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788483188.015914:0:17954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788483188.015941:0:17954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483188.015952:0:17954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788483188.016000:0:17954:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788483188.016002:0:17954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788483188.016003:0:17954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483188.016004:0:17954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483188.016005:0:17954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483188.016007:0:17954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483188.016008:0:17954:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483188.016010:0:17954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483188.016011:0:17954:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483188.016015:0:17954:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788483188.016018:0:17954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788483188.016019:0:17954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788483188.016020:0:17954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483188.016021:0:17954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483188.016022:0:17954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483188.016023:0:17954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483188.016024:0:17954:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483188.016025:0:17954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483188.016026:0:17954:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483188.016048:0:17954:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788483188.016064:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098735104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788483188.016144:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483188.016171:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788483188.016259:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098735104 00000100:00100000:3.0:1788483188.016267:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098735104 00000100:00100000:3.0:1788483188.016302:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788483188.016310:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098735104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788483188.016333:0:17216:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788483188.016344:0:17216:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788483188.019978:0:17202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788483188.020049:0:17216:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788483188.020110:0:17216:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788483188.020222:0:17238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788483188.020227:0:17238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788483188.020246:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020262:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 18 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020269:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020276:0:17238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020310:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020334:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 18 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483188.020347:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098735232:0@lo:104: 00000100:00100000:3.0:1788483188.020475:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788483188.020534:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 18 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020543:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 18 pid: 17215 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483188.020552:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098735360:0@lo:104: 00000100:00100000:2.0:1788483188.020557:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17954:x1875360098735104:12345-0@lo:253:mount.lustre.0 Request processed in 4246us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483188.020566:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788483188.020572:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.020586:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483188.020604:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098735232 00000100:00100000:3.0:1788483188.020611:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098735232 00000100:00100000:2.0:1788483188.020628:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:17954:1875360098735104:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483188.020639:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098735360 00000100:00100000:3.0:1788483188.020641:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098735360 10000000:01000000:2.0:1788483188.020644:0:17954:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788483188.020647:0:17954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788483188.020649:0:17954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788483188.020650:0:17954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483188.020651:0:17954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:3.0:1788483188.020652:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000020:01000004:2.0:1788483188.020653:0:17954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483188.020654:0:17954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483188.020655:0:17954:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483188.020657:0:17954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483188.020659:0:17954:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788483188.020660:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:17238:x1875360098735232:12345-0@lo:104: 00010000:00010000:3.0:1788483188.020670:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1788483188.020671:0:17954:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788483188.020711:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483188.020717:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:17238:x1875360098735232:12345-0@lo:104: Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483188.020723:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483188.020735:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483188.020748:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098735360:12345-0@lo:104: 00010000:00010000:3.0:1788483188.020755:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020785:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788483188.020790:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098735360:12345-0@lo:104: Request processed in 44us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483188.020795:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788483188.020810:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483188.020815:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020822:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483188.020826:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020833:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483188.020840:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483188.020847:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788483188.020871:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020877:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483188.020895:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020912:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1b80e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b815 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020923:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483188.020926:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020932:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483188.020935:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020942:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483188.020948:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483188.020953:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788483188.020968:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020972:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483188.020979:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020984:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76e00/0x1d7ea3d89ea1b74a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b751 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.020998:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483188.021006:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483188.021008:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483188.021014:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483188.021025:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098735488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483188.021054:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.021222:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483188.021229:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098735616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483188.021252:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.021296:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098735488 00000100:00100000:3.0:1788483188.021300:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098735488 00010000:00010000:3.0:1788483188.021316:0:17208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 18 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483188.021335:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098735616 00000100:00100000:3.0:1788483188.021338:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098735616 00010000:00010000:3.0:1788483188.021349:0:17208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 19 pid: 17215 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483188.021435:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483188.021443:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3619:x1875360098735488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483188.021453:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483188.021459:0:17208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 19 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021469:0:17208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 19 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021483:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483188.021511:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3619:x1875360098735488:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483188.021527:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483188.021541:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483188.021547:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3619:x1875360098735616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483188.021567:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483188.021572:0:17208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 18 pid: 17215 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021581:0:17208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 18 pid: 17215 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021593:0:17208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021601:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788483188.021613:0:17208:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015572219s 00010000:00010000:3.0:1788483188.021617:0:17208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021624:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021631:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021637:0:17208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021643:0:17208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483188.021652:0:17208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021660:0:17208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021669:0:17208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021678:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483188.021702:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3619:x1875360098735616:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483188.021708:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483188.021746:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098735616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483188.021754:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098735488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483188.021780:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76c00/0x1d7ea3d89ea1b815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b80e expref: 17 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483188.021790:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098735232:0@lo:104: 00010000:00010000:3.0:1788483188.021800:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b74a expref: 16 pid: 17215 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483188.021807:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098735360:0@lo:104: 00010000:00010000:3.0:1788483188.021820:0:17238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021829:0:17238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021845:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483188.021852:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b84d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483188.026516:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788483188.028606:0:17954:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788483188.028856:0:17979:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788483188.028860:0:17979:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788483188.028908:0:17980:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788483188.029527:0:17980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788483188.033061:0:17954:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788483188.034187:0:17981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17981:1875360098735744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788483188.034265:0:17981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.034309:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098735744 00000100:00100000:3.0:1788483188.034454:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098735744 00000100:00100000:3.0:1788483188.034494:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483188.034501:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17981:x1875360098735744:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788483188.034567:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17981:x1875360098735744:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483188.034574:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483188.034596:0:17981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c5629540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483188.034616:0:17981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17981:1875360098735744:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788483188.034641:0:17981:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788483188.034664:0:17981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17981:1875360098735872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788483188.034688:0:17981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.034709:0:17981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f3c0 going to sleep for 11 seconds 00000040:01000000:1.0:1788483188.034861:0:17954:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788483188.034908:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483188.035514:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098735872 00000100:00100000:0.0:1788483188.035521:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098735872 00000100:00100000:0.0:1788483188.035558:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483188.035566:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17981:x1875360098735872:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788483188.035672:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17981:x1875360098735872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 106us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483188.035678:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00000080:1.0:1788483188.035892:0:17954:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788483188.035900:0:17954:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1788483188.036043:0:17981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17981:1875360098735872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788483188.036113:0:17981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17981:1875360098736000:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788483188.036145:0:17981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.036181:0:17981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8fd80 going to sleep for 11 seconds 00000040:00080000:2.0:1788483188.036832:0:17980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788483188.036889:0:17980:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788483188.037058:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736000 00000100:00100000:0.0:1788483188.037065:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736000 00000100:00100000:0.0:1788483188.037139:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483188.037148:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17981:x1875360098736000:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788483188.037230:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17981:x1875360098736000:12345-0@lo:900:lod0001_rec0000.0 Request processed in 84us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483188.037237:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788483188.037467:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:3.0:1788483188.038672:0:17981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c35fb480 x1875360098736000/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788483204 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483188.038688:0:17981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17981:1875360098736000:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788483188.038755:0:17981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17981:1875360098736128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788483188.038823:0:17981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483188.038847:0:17981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f3c0 going to sleep for 11 seconds 00000040:00080000:1.0:1788483188.039399:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788483188.039767:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736128 00000100:00100000:0.0:1788483188.039775:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736128 00000100:00100000:0.0:1788483188.039825:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788483188.039835:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17981:x1875360098736128:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788483188.039941:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17981:x1875360098736128:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483188.039949:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:0.0:1788483188.040560:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788483188.040606:0:17954:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788483188.040774:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788483188.041270:0:17954:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:2.0:1788483188.042322:0:17981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17981:1875360098736128:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788483188.042382:0:17981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483188.044319:0:17981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788483188.044393:0:17981:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788483188.044398:0:17981:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788483188.046020:0:17954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788483188.056649:0:17954:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788483188.056689:0:17954:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb53845577988 00100000:10000000:0.0:1788483188.056697:0:17954:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788483188.057385:0:17954:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788483188.057415:0:17954:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788483188.057430:0:17954:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788483188.057453:0:17954:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788483188.093445:0:17954:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788483188.093705:0:17954:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788483188.543735:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788483189.056494:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483189.063424:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788483189.560205:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 10000000:01000000:3.0:1788483189.625172:0:17219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788483189.625192:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c3dba000 from 8 10000000:01000000:3.0:1788483189.625198:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788483189.625271:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483189.625286:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483189.625300:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483189.625330:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483189.625422:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483189.625504:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483189.625675:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736256 00000100:00100000:1.0:1788483189.625685:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736256 00000100:00100000:1.0:1788483189.625763:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788483189.625774:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:17219:x1875360098736256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483189.625790:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483189.625808:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b854 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483189.625836:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 17 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483189.625859:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 17 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483189.625870:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26e00, rc 0) 00000100:00100000:1.0:1788483189.625921:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098736256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483189.625929:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788483189.626351:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483189.626370:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483189.626381:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483189.626454:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788483189.626494:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483189.626527:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483189.626583:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736384 00000100:00100000:1.0:1788483189.626589:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736384 00000100:00100000:1.0:1788483189.626628:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788483189.626651:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098736384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788483189.626679:0:17216:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788483189.626840:0:17216:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788483189.626844:0:17216:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788483189.627000:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098736384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 364us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483189.627008:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788483189.627123:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788483189.627192:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788483189.627201:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483189.627210:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483189.627222:0:17219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788483189.627224:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69ece13000 from 8 10000000:01000000:2.0:1788483189.627228:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788483189.627251:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483189.627259:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483189.627268:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483189.627284:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788483189.627314:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483189.627332:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483189.628007:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736512 00000100:00100000:3.0:1788483189.628028:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736512 00000100:00100000:3.0:1788483189.628078:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788483189.628087:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098736512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483189.628118:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483189.628135:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b862 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483189.628168:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483189.628178:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483189.628195:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2e00, rc 0) 00000100:00100000:3.0:1788483189.628243:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098736512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483189.628250:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788483189.629296:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483189.629321:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483189.629333:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483189.629419:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788483189.629481:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483189.629519:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d28a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483189.629938:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736640 00000100:00100000:3.0:1788483189.629947:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736640 00000100:00100000:3.0:1788483189.630059:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483189.630072:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098736640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788483189.630120:0:17217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788483189.631064:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788483189.631071:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788483189.631287:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098736640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1215us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483189.631298:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788483189.631542:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098736640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788483189.631603:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788483189.631615:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483189.631627:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483190.073086:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483190.078020:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483190.590263:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788483191.103662:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483191.609258:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788483192.120283:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483192.633183:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 0 seconds 00000100:00100000:2.0:1788483193.087415:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483193.087437:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098736768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483193.087501:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483193.087601:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736768 00000100:00100000:0.0:1788483193.087608:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736768 00000100:00100000:0.0:1788483193.087656:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788483193.087666:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098736768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483193.087694:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483193.087740:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098736768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483193.087746:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788483193.087788:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098736768:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788483193.089287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788483193.089292:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788483193.089295:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483193.089304:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69ed823000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483193.089326:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e6300 x1875360098737024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483193.089343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483193.089347:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483193.089349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483193.089352:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483193.089371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483193.089375:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483193.089377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483193.089380:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483193.089420:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098737152:0@lo:400:kworker.0 00000100:00100000:1.0:1788483193.089474:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483193.089501:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483193.089507:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098737280:0@lo:400:kworker.0 00000100:00100000:1.0:1788483193.089528:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483193.089550:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483193.089557:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098736896:0@lo:400:kworker.0 00000100:00100000:1.0:1788483193.089587:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483193.096184:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737152 00000100:00100000:3.0:1788483193.096199:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737152 00000100:00100000:3.0:1788483193.096272:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737280 00000100:00100000:3.0:1788483193.096276:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737280 00000100:00100000:3.0:1788483193.096295:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483193.096303:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098737152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483193.096328:0:17222:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788483193.096337:0:17222:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788483193.096387:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098737152:12345-0@lo:400:kworker.0 Request processed in 85us (6912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483193.096394:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483193.096408:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483193.096414:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098737280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483193.096441:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098737280:12345-0@lo:400:kworker.0 Request processed in 27us (6911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483193.096446:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483193.096469:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098737024:0@lo:38:kworker.0 00000100:00100000:3.0:1788483193.096507:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483193.096538:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737024 00000100:00100000:0.0:1788483193.096542:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737024 00000100:00100000:0.0:1788483193.096563:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788483193.096565:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c59e4700 x1875360098737280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483193.096567:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098737024:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788483193.096578:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098737280:0@lo:400:kworker.0 00010000:00080000:3.0:1788483193.096589:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c59e5f80 x1875360098737152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788483193.096589:0:17963:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000100:00100000:3.0:1788483193.096596:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098737152:0@lo:400:kworker.0 00000020:00000080:0.0:1788483193.096617:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1b870 00000004:00100000:0.0:1788483193.096630:0:17963:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788483193.096636:0:17963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788483193.096807:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098736896 00000100:00100000:2.0:1788483193.096811:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098736896 00000100:00100000:2.0:1788483193.096851:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788483193.096859:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3621:x1875360098736896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483193.096909:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3621:x1875360098736896:12345-0@lo:400:kworker.0 Request processed in 52us (7321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483193.096916:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788483193.097890:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098736896:0@lo:400:kworker.0 00000100:00080000:2.0:1788483193.115400:0:17963:0:(import.c:65:import_set_state_nolock()) ffff9a69efd45800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483193.115497:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098737024:12345-0@lo:38:kworker.0 Request processed in 18926us (18987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483193.115520:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788483193.115630:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788483193.115645:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788483193.115650:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788483193.115653:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788483193.115673:0:3618:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005b9ec578): req@ffff9a69c59e4380 x1875360098729600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483193.115691:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098737024:0@lo:38:kworker.0 00000100:00100000:3.0:1788483193.117870:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483193.117889:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098737408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483193.117947:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483193.118081:0:17264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483193.118125:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483193.118141:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737408 00000100:00100000:2.0:1788483193.118148:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737408 00000100:00100000:2.0:1788483193.118196:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098729600 00000100:00100000:2.0:1788483193.118199:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098729600 00000100:00100000:2.0:1788483193.118212:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483193.118220:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3622:x1875360098737408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483193.118252:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788483193.118293:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3622:x1875360098737408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483193.118300:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483193.118315:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788483193.118321:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17264:x1875360098729600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483193.118378:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17264:x1875360098729600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 57us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483193.118385:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788483193.118418:0:17264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17264:1875360098729600:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788483193.118449:0:17264:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788483193.118478:0:17264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17264:1875360098737536:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483193.118503:0:17264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483193.118525:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788483193.118534:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737536 00000100:00100000:2.0:1788483193.118537:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737536 00000100:00100000:2.0:1788483193.118556:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483193.118568:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17264:x1875360098737536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483193.118652:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17264:x1875360098737536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483193.118658:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483193.118681:0:17264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17264:1875360098737536:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483193.118736:0:17264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17264:1875360098737664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483193.118757:0:17264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483193.118769:0:17264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788483193.118779:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737664 00000100:00100000:2.0:1788483193.118783:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737664 00000100:00100000:2.0:1788483193.118801:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483193.118806:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17264:x1875360098737664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483193.118846:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17264:x1875360098737664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483193.118851:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483193.118873:0:17264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17264:1875360098737664:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788483193.118906:0:17264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483193.122782:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098737408:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788483193.123521:0:17264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788483193.123600:0:17264:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1788483193.123605:0:17264:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788483193.144322:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788483193.251014:0:18224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788483194.183541:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788483194.224946:0:18277:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788483194.225346:0:18277:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788483195.163086:0:18327:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788483195.163677:0:18327:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788483195.195134:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483195.641694:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788483196.188282:0:18375:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea7bc0e90 20000000:00000080:0.0:1788483196.188305:0:18375:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a69f6af8400 uarg=0000000000000000 20000000:01000000:0.0:1788483196.188362:0:18375:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788483196.188372:0:18375:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788483196.188377:0:18375:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788483196.188952:0:18376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788483196.189419:0:18375:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788483196.201488:0:18375:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788483196.201532:0:18375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483196.201556:0:18375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 17 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483196.201565:0:18375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 17 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483196.201573:0:18375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483196.201800:0:18375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 17 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483196.201821:0:18375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 17 pid: 17216 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483196.201857:0:18375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18375:1875360098737792:0@lo:104: 00000100:00100000:2.0:1788483196.201944:0:18375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788483196.202022:0:18375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 17 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483196.202031:0:18375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 17 pid: 17217 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483196.202039:0:18375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18375:1875360098737920:0@lo:104: 00000100:00100000:2.0:1788483196.202062:0:18375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483196.202210:0:18375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1d49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483196.202322:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737792 00000100:00100000:3.0:1788483196.202333:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737792 00000100:00100000:3.0:1788483196.202382:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098737920 00000100:00100000:3.0:1788483196.202385:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098737920 00000100:00100000:3.0:1788483196.202402:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483196.202412:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:18375:x1875360098737792:12345-0@lo:104: 00010000:00010000:3.0:1788483196.202427:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202516:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483196.202525:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:18375:x1875360098737792:12345-0@lo:104: Request processed in 113us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483196.202533:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483196.202552:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483196.202558:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:18375:x1875360098737920:12345-0@lo:104: 00010000:00010000:3.0:1788483196.202566:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202598:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788483196.202602:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:18375:x1875360098737920:12345-0@lo:104: Request processed in 45us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483196.202607:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788483196.202624:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483196.202630:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202652:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9a00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483196.202658:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202666:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483196.202673:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483196.202678:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483196.202711:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202717:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483196.202737:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202744:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1b81c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b823 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202758:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483196.202761:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202766:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483196.202768:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202785:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483196.202791:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483196.202796:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483196.202811:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202815:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483196.202830:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202836:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26c00/0x1d7ea3d89ea1b719 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b720 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.202850:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483196.202851:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483196.202852:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483196.202868:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483196.202881:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098738048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483196.202912:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483196.202939:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098738176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483196.202964:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483196.203010:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098738048 00000100:00100000:3.0:1788483196.203015:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098738048 00010000:00010000:3.0:1788483196.203036:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 18 pid: 17216 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483196.203069:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098738176 00000100:00100000:3.0:1788483196.203073:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098738176 00010000:00010000:3.0:1788483196.203085:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 19 pid: 17217 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483196.203124:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483196.203132:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3621:x1875360098738048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483196.203145:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483196.203161:0:17207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 19 pid: 17216 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483196.203172:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483196.203174:0:17207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 19 pid: 17216 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203192:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483196.203223:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3621:x1875360098738048:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483196.203231:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483196.203244:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483196.203250:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3619:x1875360098738176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483196.203258:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483196.203262:0:17207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 18 pid: 17217 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203270:0:17207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 18 pid: 17217 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203282:0:17207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203297:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203312:0:17207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203320:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203327:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203334:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203339:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483196.203344:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203351:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203359:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483196.203370:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483196.203398:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3619:x1875360098738176:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483196.203405:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483196.203959:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098738176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483196.204072:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098738048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483196.204276:0:18375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77000/0x1d7ea3d89ea1b823 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b81c expref: 17 pid: 17216 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483196.204291:0:18375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18375:1875360098737792:0@lo:104: 00010000:00010000:2.0:1788483196.204302:0:18375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1b720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b719 expref: 16 pid: 17217 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483196.204311:0:18375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18375:1875360098737920:0@lo:104: 00010000:00010000:2.0:1788483196.204332:0:18375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483196.204342:0:18375:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483196.204348:0:18375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483196.204367:0:18375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1b877 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483196.223317:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483197.177305:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483187/real 1788483187] req@ffff9a69fd934380 x1875360098733184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483197.177333:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69fd934380 x1875360098733184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483197.177342:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483187/real 1788483187] req@ffff9a69fd934700 x1875360098732928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483197.177353:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69fd934700 x1875360098732928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483197.177364:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483182/real 1788483182] req@ffff9a69c59e5500 x1875360098730624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483197.177374:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69c59e5500 x1875360098730624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788483197.177391:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483197.177415:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788483197.177419:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098733184:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788483197.177425:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dc000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483197.177430:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788483197.177434:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098732928:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788483197.177447:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483197.177452:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788483197.177455:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098730624:0@lo:8:kworker.0 00000100:00080000:1.0:1788483197.177687:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483197.177691:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788483197.177693:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483197.177698:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1788483197.177703:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483197.177709:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a69d18c9800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483197.177726:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e6a00 x1875360098738560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483197.177739:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483197.177742:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483197.177756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483197.177759:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788483197.177760:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dc000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483197.177763:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788483197.177765:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483197.177768:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a69d25dc000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483197.177790:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e6300 x1875360098738944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483197.177798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483197.177813:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788483197.177815:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483197.177818:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788483197.177821:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483197.177824:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69c2b8d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483197.177836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e5c00 x1875360098739072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483197.177868:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098738432:0@lo:400:kworker.0 00000100:00100000:1.0:1788483197.177929:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483197.177961:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483197.177967:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098738688:0@lo:400:kworker.0 00000100:00100000:1.0:1788483197.177992:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483197.178026:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098738432 00000100:00100000:1.0:1788483197.178033:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098738432 00000100:00100000:1.0:1788483197.178074:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788483197.178300:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098738304:0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.178334:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483197.178360:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098739200:0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.178381:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483197.178400:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483197.178405:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098738816:0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.178425:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483197.178450:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098738304 00000100:00100000:3.0:1788483197.178454:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098738304 00000100:00100000:3.0:1788483197.178484:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788483197.178491:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:3620:x1875360098738304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.178535:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:3620:x1875360098738304:12345-0@lo:400:kworker.0 Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483197.178542:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788483197.178591:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098738688 00000100:00100000:3.0:1788483197.178595:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098738688 00000100:00100000:3.0:1788483197.178618:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098739200 00000100:00100000:3.0:1788483197.178621:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098739200 00000100:00100000:3.0:1788483197.178637:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483197.178643:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098738688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.178681:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098738688:12345-0@lo:400:kworker.0 Request processed in 38us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483197.178688:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483197.178700:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483197.178705:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098739200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.178741:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098739200:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483197.178746:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483197.178764:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098738816 00000100:00100000:3.0:1788483197.178768:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098738816 00000100:00100000:3.0:1788483197.178783:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788483197.178789:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098738816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.178961:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098738816:12345-0@lo:400:kworker.0 Request processed in 172us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483197.178967:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788483197.179007:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098738816:0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.179015:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098738304:0@lo:400:kworker.0 00010000:00080000:3.0:1788483197.179026:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c59e5f80 x1875360098739200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483197.179036:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098739200:0@lo:400:kworker.0 00000100:00100000:3.0:1788483197.179081:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098738560:0@lo:8:kworker.0 00000100:00100000:1.0:1788483197.179225:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098738432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483197.179262:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098738432:12345-0@lo:400:kworker.0 Request processed in 1180us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483197.179269:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788483197.179299:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c59e5500 x1875360098738688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483197.179309:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098738688:0@lo:400:kworker.0 00000100:00100000:1.0:1788483197.179329:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098738432:0@lo:400:kworker.0 00000400:00000100:3.0:1788483197.180275:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098738560 offset 0 length 520: 4 00000100:00100000:3.0:1788483197.180305:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098738944:0@lo:8:kworker.0 00000400:00000100:3.0:1788483197.180326:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098738944 offset 0 length 520: 4 00000100:00100000:3.0:1788483197.180335:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098739072:0@lo:8:kworker.0 00000400:00000100:3.0:1788483197.180350:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098739072 offset 0 length 520: 4 00010000:00010000:0.0:1788483197.240725:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788483198.143651:0:17219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788483198.143658:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c3dba000 from 13 10000000:01000000:2.0:1788483198.143664:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788483198.143707:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483198.143719:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483198.143731:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483198.143755:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788483198.143824:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483198.143869:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e01359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483198.143924:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098739328 00000100:00100000:0.0:1788483198.143931:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098739328 00000100:00100000:0.0:1788483198.143983:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788483198.143991:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+16:17219:x1875360098739328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483198.144004:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483198.144025:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b87e expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.144046:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 17 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.144057:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 17 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.144066:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9600, rc 0) 00000100:00100000:0.0:1788483198.144137:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098739328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483198.144152:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788483198.144251:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483198.144264:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483198.144282:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483198.144343:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483198.144367:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483198.144405:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e01359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483198.144470:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098739456 00000100:00100000:0.0:1788483198.144474:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098739456 00000100:00100000:0.0:1788483198.144511:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483198.144517:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098739456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.144620:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098739456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483198.144627:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483198.144655:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.144678:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.144725:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483198.144737:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788483198.144746:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098739584 00000100:00100000:0.0:1788483198.144749:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098739584 00000100:00100000:0.0:1788483198.144765:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483198.144770:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098739584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.144843:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098739584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483198.144849:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483198.144888:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788483198.145565:0:18449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788483198.145621:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788483198.145642:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483198.145652:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.145663:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483198.145672:0:17219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788483198.145674:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69ece13000 from 13 10000000:01000000:0.0:1788483198.145677:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788483198.145698:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.145706:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.145715:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483198.145738:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.145772:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483198.145787:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483198.145801:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098739712 00000100:00100000:0.0:1788483198.145805:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098739712 00000100:00100000:0.0:1788483198.145828:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788483198.145834:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+17:17219:x1875360098739712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483198.145843:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483198.145853:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b88c expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.145869:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 18 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.145877:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 18 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.145886:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9e00, rc 0) 00000100:00100000:0.0:1788483198.145915:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098739712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483198.145920:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788483198.145952:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483198.145962:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.145971:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483198.146014:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.146038:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483198.146050:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483198.146060:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098739840 00000100:00100000:0.0:1788483198.146064:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098739840 00000100:00100000:0.0:1788483198.146080:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788483198.146085:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d135bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098739840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.146195:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d135bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098739840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483198.146202:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788483198.146229:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.146251:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.146287:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483198.146299:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3ea9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483198.146310:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098739968 00000100:00100000:0.0:1788483198.146314:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098739968 00000100:00100000:0.0:1788483198.146329:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788483198.146335:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098739968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483198.146398:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:17219:x1875360098739968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483198.146404:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788483198.146439:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098739968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788483198.151291:0:18450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788483198.151396:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788483198.151428:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483198.151438:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483198.151449:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483198.200635:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483183/real 1788483183] req@ffff9a68c35f9f80 x1875360098731136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483198 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483198.200666:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a68c35f9f80 x1875360098731136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483198 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483198.200686:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483198.200705:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788483198.200709:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098731136:0@lo:8:kworker.0 00000100:00080000:2.0:1788483198.200800:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483198.200805:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483198.200807:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483198.200810:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788483198.200812:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483198.200817:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:2.0:1788483198.200822:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788483198.200827:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69efd93800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483198.200845:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd935880 x1875360098740224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483198.200876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483198.200879:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483198.200881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483198.200884:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788483198.200909:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098740480:0@lo:400:kworker.0 00000100:00100000:2.0:1788483198.200962:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483198.200989:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483198.200994:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098740608:0@lo:400:kworker.0 00000100:00100000:2.0:1788483198.201016:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483198.201069:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098740096:0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.201121:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483198.201151:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483198.201157:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098740352:0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.201179:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483198.201208:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098740480 00000100:00100000:3.0:1788483198.201214:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098740480 00000100:00100000:3.0:1788483198.201250:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098740096 00000100:00100000:3.0:1788483198.201253:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098740096 00000100:00100000:3.0:1788483198.201269:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788483198.201276:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098740480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.201322:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098740480:12345-0@lo:400:kworker.0 Request processed in 46us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483198.201329:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788483198.201343:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788483198.201349:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098740096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.201377:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098740096:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483198.201382:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788483198.201408:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098740608 00000100:00100000:3.0:1788483198.201411:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098740608 00000100:00100000:3.0:1788483198.201433:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098740352 00000100:00100000:3.0:1788483198.201435:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098740352 00000100:00100000:3.0:1788483198.201449:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483198.201454:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098740608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.201548:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098740608:12345-0@lo:400:kworker.0 Request processed in 93us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483198.201555:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483198.201566:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788483198.201571:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098740352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.201595:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098740352:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483198.201600:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788483198.201631:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098740224:0@lo:8:kworker.0 00000100:00100000:0.0:1788483198.201728:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483198.201736:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098740736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483198.201761:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483198.201875:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098740736 00000100:00100000:2.0:1788483198.201880:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098740736 00000100:00100000:2.0:1788483198.201932:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788483198.201939:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098740736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483198.201970:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788483198.202006:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098740736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483198.202013:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483198.202360:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098740736:0@lo:41:osp-pre-0-1.0 00000400:00000100:3.0:1788483198.202670:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098740224 offset 0 length 520: 4 00000100:00100000:0.0:1788483198.202917:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098740864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483198.202944:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483198.203006:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098740864 00000100:00100000:2.0:1788483198.203011:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098740864 00000100:00100000:2.0:1788483198.203047:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788483198.203054:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098740864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483198.203072:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788483198.203129:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098740864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483198.203136:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788483198.203216:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098740864:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788483198.203264:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69fd936300 x1875360098740352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483198.203275:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098740352:0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.203288:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098740096:0@lo:400:kworker.0 00010000:00080000:3.0:1788483198.203317:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69fd936680 x1875360098740608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483198.203327:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098740608:0@lo:400:kworker.0 00000100:00100000:3.0:1788483198.203338:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098740480:0@lo:400:kworker.0 00010000:00010000:0.0:1788483198.266344:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788483198.728153:0:17955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788483199.290152:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483200.317145:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483200.317694:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788483201.337830:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483202.360739:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483203.320859:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483203.320865:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483203.320868:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483203.320871:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483203.321017:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098740992:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321083:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483203.321172:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483203.321178:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098741120:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321204:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483203.321234:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098741248:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321258:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483203.321276:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483203.321281:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098741376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483203.321300:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483203.321329:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098740992 00000100:00100000:3.0:1788483203.321336:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098740992 00000100:00100000:3.0:1788483203.321377:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788483203.321386:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3619:x1875360098740992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321427:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:3619:x1875360098740992:12345-0@lo:400:kworker.0 Request processed in 42us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.321434:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788483203.321460:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098741248 00000100:00100000:3.0:1788483203.321463:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098741248 00000100:00100000:3.0:1788483203.321484:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483203.321489:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098741248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321521:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098741248:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.321526:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483203.321540:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098741120 00000100:00100000:3.0:1788483203.321553:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098741120 00000100:00100000:3.0:1788483203.321573:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098741376 00000100:00100000:3.0:1788483203.321575:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098741376 00000100:00100000:3.0:1788483203.321587:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483203.321592:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098741120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321625:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875360098741120:12345-0@lo:400:kworker.0 Request processed in 32us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.321631:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483203.321642:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788483203.321648:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098741376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788483203.321670:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483203.321700:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098741376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.321705:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788483203.321738:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098741120:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321747:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098740992:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.321778:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098741376:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788483203.321789:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69fd8f6680 x1875360098741248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483203.321800:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098741248:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.323343:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098741504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483203.323394:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483203.323438:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098741504 00000100:00100000:3.0:1788483203.323444:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098741504 00000100:00100000:3.0:1788483203.323477:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788483203.323490:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098741504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483203.323515:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788483203.323549:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098741504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.323554:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788483203.323588:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098741504:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788483203.329625:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483203.329635:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483203.329638:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483203.329641:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483203.330327:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098741632:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.330394:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.330517:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098741632 00000100:00100000:2.0:1788483203.330525:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098741632 00000100:00100000:2.0:1788483203.330578:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483203.330587:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098741632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483203.330640:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098741632:12345-0@lo:400:kworker.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.330648:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788483203.330684:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69fd8f6d80 x1875360098741632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483203.330697:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098741632:0@lo:400:kworker.0 00010000:00010000:1.0:1788483203.391641:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788483203.482054:0:18724:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788483203.482057:0:18724:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788483203.482059:0:18724:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788483203.482880:0:18724:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a69d0564000 00000020:01000004:0.0:1788483203.482966:0:18724:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788483203.482979:0:18724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788483203.482994:0:18724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a68c24e19b8) 00000020:00000080:0.0:1788483203.483010:0:18724:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788483203.577430:0:18724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788483203.580326:0:18724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788483203.584238:0:18724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788483203.585061:0:18724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788483203.585398:0:18724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788483203.586052:0:18724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788483203.586346:0:18724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788483203.589475:0:18724:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788483203.590473:0:18724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788483203.590486:0:18724:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483203.590515:0:18724:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d7ea3d89ea1b8a1 00000020:01000004:3.0:1788483203.590523:0:18724:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788483203.590544:0:18724:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788483203.590548:0:18724:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788483203.590554:0:18724:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788483203.590559:0:18724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788483203.590571:0:18724:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a69d0460000) 00000020:00000080:3.0:1788483203.590583:0:18724:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788483203.591756:0:18724:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483203.591922:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788483203.591929:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788483203.606123:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788483203.606143:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788483203.608442:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788483203.608453:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788483203.610701:0:18724:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483203.610890:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788483203.610897:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788483203.618577:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788483203.618591:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788483203.645764:0:18724:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483203.646074:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788483203.646472:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788483203.647863:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788483203.647880:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788483203.648871:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788483203.648879:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788483203.651449:0:18724:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483203.651643:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788483203.651649:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788483203.652669:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788483203.652678:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788483203.707060:0:18724:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483203.707348:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788483203.707354:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788483203.717288:0:18724:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788483203.717306:0:18724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788483203.723335:0:18724:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788483203.723367:0:18724:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788483203.723373:0:18724:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788483203.746791:0:18724:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788483203.746829:0:18724:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.154@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788483203.746833:0:18724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788483203.746835:0:18724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788483203.746837:0:18724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483203.746838:0:18724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483203.746839:0:18724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483203.746841:0:18724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483203.746842:0:18724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483203.746844:0:18724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483203.746845:0:18724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788483203.746849:0:18724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788483203.746851:0:18724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788483203.746853:0:18724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788483203.746854:0:18724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483203.746855:0:18724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483203.746856:0:18724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483203.746857:0:18724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483203.746858:0:18724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483203.746859:0:18724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483203.746860:0:18724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788483203.746893:0:18724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788483203.746913:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098741760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788483203.747053:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.747282:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.747408:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098741760 00000100:00100000:3.0:1788483203.747415:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098741760 00000100:00100000:3.0:1788483203.747464:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788483203.747473:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:18724:x1875360098741760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788483203.747511:0:17217:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788483203.747514:0:17217:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788483203.747518:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788483203.747778:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:18724:x1875360098741760:12345-0@lo:253:mount.lustre.0 Request processed in 306us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.747787:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788483203.747861:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098741760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788483203.747871:0:18724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788483203.747873:0:18724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788483203.747875:0:18724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788483203.747876:0:18724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483203.747878:0:18724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483203.747879:0:18724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483203.747880:0:18724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483203.747881:0:18724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483203.747883:0:18724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483203.747889:0:18724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788483203.747906:0:18724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69d0564000 from lustre-OST0000 10000000:01000000:2.0:1788483203.747939:0:18724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788483203.747942:0:18724:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788483203.747950:0:18724:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69edaa0000 local copy 00010000:00010000:2.0:1788483203.747959:0:18724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483203.748046:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098741888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483203.748075:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.748244:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.748392:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098741888 00000100:00100000:3.0:1788483203.748397:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098741888 00000100:00100000:3.0:1788483203.748461:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788483203.748469:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:18724:x1875360098741888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483203.748530:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:18724:x1875360098741888:12345-0@lo:501:mount.lustre.0 Request processed in 62us (454us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788483203.748537:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788483203.748583:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098741888:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788483203.748594:0:18724:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788483203.748609:0:18724:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788483203.748614:0:18724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.748623:0:18724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483203.748644:0:18724:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69d0564000 10000000:01000000:2.0:1788483203.748648:0:18724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788483203.748652:0:18724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788483203.748654:0:18724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788483203.748658:0:18724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788483203.748661:0:18724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788483203.748677:0:18724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.748684:0:18724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.748700:0:18724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483203.748713:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483203.748737:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.755563:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788483203.756596:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742016 00000100:00100000:0.0:1788483203.756609:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742016 00000100:00100000:0.0:1788483203.756658:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788483203.756667:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+18:18724:x1875360098742016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483203.756683:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483203.756699:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b8b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b8af expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483203.756727:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8af expref: 19 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483203.756876:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8af expref: 19 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483203.756884:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9800, rc 0) 00000100:00100000:0.0:1788483203.756960:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742016:12345-0@lo:101:mount.lustre.0 Request processed in 293us (8221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483203.756984:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788483203.757268:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483203.757285:0:18724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.757294:0:18724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483203.760683:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788483203.761473:0:18724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483203.764724:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788483203.764775:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788483203.764791:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788483203.764806:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788483203.764821:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788483203.764838:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788483203.764865:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788483203.764871:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788483203.764967:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483203.765337:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.765413:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.765474:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742144 00000100:00100000:3.0:1788483203.765481:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742144 00000100:00100000:1.0:1788483203.767873:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788483203.767895:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483203.771329:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742144:12345-0@lo:501:mount.lustre.0 Request processed in 3436us (5984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483203.771342:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788483203.771433:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483203.771480:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483203.771960:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483203.772141:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d1bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.776288:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742272 00000100:00100000:3.0:1788483203.776302:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742272 00000100:00100000:3.0:1788483203.776418:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788483203.776429:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483203.778747:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742272:12345-0@lo:503:mount.lustre.0 Request processed in 2312us (6779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.778759:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788483203.781781:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788483203.782481:0:18724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788483203.783700:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483203.783777:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483203.783872:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d1bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.784684:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742400 00000100:00100000:3.0:1788483203.784693:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742400 00000100:00100000:3.0:1788483203.784755:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788483203.784765:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483203.786460:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742400:12345-0@lo:502:mount.lustre.0 Request processed in 1691us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.786472:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788483203.786628:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483203.786870:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788483203.786903:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788483203.786918:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788483203.786931:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788483203.786943:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788483203.786956:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788483203.786967:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788483203.786992:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788483203.787007:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788483203.787018:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788483203.787030:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788483203.787045:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788483203.787078:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483203.787275:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483203.788991:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d1bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483203.792089:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742528 00000100:00100000:1.0:1788483203.792135:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742528 00000100:00100000:2.0:1788483203.793270:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788483203.793288:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483203.793471:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742528:12345-0@lo:502:mount.lustre.0 Request processed in 190us (6195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.793478:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788483203.793638:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483203.793719:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788483203.793733:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788483203.796326:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788483203.796336:0:18741:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788483203.796342:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483203.796344:0:18741:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788483203.796349:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483203.796363:0:18741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a69d0464d28) 00000020:00000080:3.0:1788483203.796385:0:18741:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788483203.796390:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788483203.796474:0:18741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69d0564000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788483203.796483:0:18741:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788483203.796489:0:18741:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d7ea3d89ea1b8c4 00010000:00010000:2.0:1788483203.802397:0:18741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788483203.804410:0:18741:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788483203.807720:0:18741:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788483203.812699:0:18741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788483203.812712:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483203.812719:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.812722:0:18741:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788483203.812726:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788483203.812729:0:18741:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788483203.812730:0:18741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788483203.812732:0:18741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788483203.812734:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788483203.812737:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.812738:0:18741:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788483203.812741:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483203.812745:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.812747:0:18741:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788483203.812751:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788483203.812753:0:18741:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788483203.812756:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483203.812759:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.812761:0:18741:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788483203.812763:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483203.812767:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.812769:0:18741:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788483203.812773:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788483203.812803:0:18741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483203.812806:0:18741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.812808:0:18741:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788483203.812812:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788483203.816661:0:18724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788483203.816703:0:18724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788483203.816723:0:18724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.816735:0:18724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483203.816743:0:18724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d0564000 from 1 10000000:01000000:2.0:1788483203.816746:0:18724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788483203.816780:0:18724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.816788:0:18724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.816798:0:18724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483203.816820:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483203.816879:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.818894:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.825142:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742656 00000100:00100000:3.0:1788483203.825157:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742656 00000100:00100000:3.0:1788483203.825222:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788483203.825234:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:18724:x1875360098742656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483203.825250:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483203.825266:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b8cb expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.825292:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 20 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.825304:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 20 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.825313:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e3600, rc 0) 00000100:00100000:3.0:1788483203.825381:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098742656:12345-0@lo:101:mount.lustre.0 Request processed in 149us (8501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.825388:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788483203.825525:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483203.825550:0:18724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.825560:0:18724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483203.830711:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788483203.831683:0:18724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788483203.831917:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788483203.831944:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788483203.831964:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788483203.831992:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788483203.833306:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483203.833374:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483203.833459:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483203.836868:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742784 00000100:00100000:1.0:1788483203.836882:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742784 00000100:00100000:1.0:1788483203.836986:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788483203.836997:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098742784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483203.837433:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098742784:12345-0@lo:501:mount.lustre.0 Request processed in 437us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483203.837457:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788483203.837561:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483203.837610:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483203.837655:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483203.849302:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.851939:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098742912 00000100:00100000:3.0:1788483203.851953:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098742912 00000100:00100000:3.0:1788483203.852315:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788483203.852324:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098742912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483203.852485:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098742912:12345-0@lo:503:mount.lustre.0 Request processed in 161us (14829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.852493:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788483203.852584:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098742912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788483203.853031:0:18724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483203.853160:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483203.853208:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483203.853239:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.853417:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743040 00000100:00100000:3.0:1788483203.853423:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743040 00000100:00100000:3.0:1788483203.853447:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788483203.853454:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098743040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483203.853541:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098743040:12345-0@lo:502:mount.lustre.0 Request processed in 86us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.853553:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788483203.853618:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483203.853776:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788483203.853814:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788483203.853828:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788483203.853839:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788483203.853850:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788483203.853861:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788483203.853872:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788483203.853884:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788483203.853896:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788483203.853907:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788483203.853918:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788483203.853937:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483203.853968:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483203.854000:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.854039:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743168 00000100:00100000:3.0:1788483203.854043:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743168 00000100:00100000:3.0:1788483203.854070:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788483203.854076:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098743168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483203.854171:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098743168:12345-0@lo:502:mount.lustre.0 Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.854178:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788483203.854341:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483203.854376:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788483203.854383:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788483203.854876:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483203.854885:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.854887:0:18745:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788483203.854892:0:18745:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69d0564000 00000020:00000080:0.0:1788483203.854895:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788483203.854903:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483203.854905:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.854907:0:18745:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788483203.854909:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483203.854911:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.854913:0:18745:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788483203.854916:0:18745:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69d0564000 00000020:00000080:0.0:1788483203.854918:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788483203.854966:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483203.854977:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.854978:0:18745:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788483203.854980:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483203.854982:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.854983:0:18745:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788483203.854986:0:18745:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69d0564000 00000020:00000080:0.0:1788483203.854988:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788483203.855005:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483203.855008:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.855009:0:18745:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788483203.855011:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483203.855013:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.855015:0:18745:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788483203.855018:0:18745:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69d0564000 00000020:00000080:0.0:1788483203.855020:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788483203.855050:0:18745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483203.855062:0:18745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483203.855064:0:18745:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788483203.855067:0:18745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788483203.871264:0:18724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788483203.871306:0:18724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788483203.874523:0:18724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.874541:0:18724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483203.874681:0:18724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788483203.874685:0:18724:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69d0564000 10000000:01000000:2.0:1788483203.874688:0:18724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69d0564000 10000000:01000000:2.0:1788483203.874692:0:18724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788483203.874698:0:18724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69d0564000 from 1 10000000:01000000:2.0:1788483203.874701:0:18724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788483203.874734:0:18724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.874742:0:18724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.874753:0:18724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483203.874775:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483203.874841:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.874877:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483203.888142:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743296 00000100:00100000:2.0:1788483203.888156:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743296 00000100:00100000:2.0:1788483203.888211:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788483203.888221:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:18724:x1875360098743296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483203.888236:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483203.888253:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1b8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b8d9 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.888278:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1b8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8d9 expref: 21 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.888288:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1b8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8d9 expref: 21 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.888297:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76800, rc 0) 00000100:00100000:2.0:1788483203.888365:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743296:12345-0@lo:101:mount.lustre.0 Request processed in 146us (13524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.888373:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788483203.888423:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483203.888439:0:18724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.888449:0:18724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483203.890504:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788483203.890788:0:18724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483203.890956:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788483203.894317:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788483203.894350:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788483203.894362:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788483203.894373:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788483203.894385:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788483203.894418:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788483203.894433:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788483203.894446:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788483203.894457:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788483203.894469:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788483203.894480:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788483203.894493:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788483203.894505:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788483203.894519:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788483203.894532:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788483203.894545:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788483203.894556:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788483203.894568:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788483203.894581:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788483203.894596:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788483203.894611:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788483203.894639:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788483203.894656:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788483203.894672:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788483203.894687:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788483203.894702:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788483203.894716:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788483203.894731:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788483203.894746:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788483203.894760:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788483203.894774:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788483203.894800:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788483203.894816:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788483203.894831:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788483203.894845:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788483203.894859:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788483203.894888:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788483203.894894:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788483203.898239:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483203.898309:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.898355:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743424 00000100:00100000:2.0:1788483203.898362:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743424 00000100:00100000:2.0:1788483203.898407:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788483203.898416:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483203.898529:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743424:12345-0@lo:501:mount.lustre.0 Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.898536:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788483203.898579:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788483203.898599:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483203.898632:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483203.903204:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.903250:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ca995cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483203.905411:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743552 00000100:00100000:2.0:1788483203.905425:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743552 00000100:00100000:2.0:1788483203.905480:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788483203.905490:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483203.905633:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743552:12345-0@lo:503:mount.lustre.0 Request processed in 144us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.905650:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788483203.905710:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743552:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788483203.906932:0:18724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788483203.910320:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483203.910397:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.910438:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ca995cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483203.910466:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743680 00000100:00100000:2.0:1788483203.910473:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743680 00000100:00100000:2.0:1788483203.910519:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788483203.910529:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483203.910638:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743680:12345-0@lo:502:mount.lustre.0 Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.910646:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788483203.910703:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483203.910890:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788483203.910919:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788483203.910931:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788483203.910942:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788483203.910955:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788483203.910967:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788483203.911249:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788483203.911265:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788483203.911276:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788483203.911288:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788483203.911300:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788483203.911310:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788483203.911321:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788483203.911344:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788483203.911371:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788483203.911385:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788483203.911397:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788483203.911409:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788483203.911421:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788483203.911433:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788483203.911445:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788483203.911458:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788483203.911469:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788483203.911479:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788483203.911489:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788483203.911515:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788483203.911529:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788483203.911540:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788483203.911551:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788483203.911562:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788483203.911584:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788483203.911597:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788483203.911607:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788483203.911617:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788483203.911629:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788483203.911641:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788483203.911654:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788483203.911666:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788483203.911678:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788483203.911689:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788483203.911700:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788483203.911713:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788483203.911724:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788483203.911737:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788483203.911749:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788483203.911760:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788483203.911791:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788483203.911806:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788483203.911846:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483203.911900:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.911938:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743808 00000100:00100000:2.0:1788483203.911944:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743808 00000100:00100000:2.0:1788483203.915624:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788483203.915641:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483203.915793:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743808:12345-0@lo:502:mount.lustre.0 Request processed in 156us (3891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.915800:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788483203.915870:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483203.915895:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483203.916394:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788483203.916423:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788483203.916454:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483203.917298:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.918078:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e007c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788483203.919801:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098743936 00000100:00100000:3.0:1788483203.919812:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098743936 00000100:00100000:2.0:1788483203.919912:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788483203.919922:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483203.920171:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098743936:12345-0@lo:502:mount.lustre.0 Request processed in 250us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.920179:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788483203.920236:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098743936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483203.920306:0:18724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788483203.920325:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788483203.922805:0:18750:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788483203.922822:0:18750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a69c55f19b8) 00000020:00000080:1.0:1788483203.922845:0:18750:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788483203.922937:0:18750:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69d0564000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788483203.922941:0:18750:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69d0564000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788483203.922944:0:18750:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d0564000 3 00010000:00080000:1.0:1788483203.923073:0:18750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c331a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788483203.928578:0:18750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788483203.928796:0:18750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788483203.928840:0:18750:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788483203.928853:0:18750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1d7ea3d89ea1b8ee 00000100:00080000:1.0:1788483203.928862:0:18750:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788483203.928868:0:18750:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a68c331a800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483203.928900:0:18750:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd8f5500 x1875360098744064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483203.928942:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098744064:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483203.929006:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788483203.929057:0:18750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788483203.934184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483203.934190:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483203.934193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483203.934196:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483203.934222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483203.934226:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483203.934228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483203.934231:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483203.934267:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744064 00000100:00100000:0.0:1788483203.934273:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744064 00000100:00100000:0.0:1788483203.934307:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483203.934316:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098744064:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788483203.934339:0:17223:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1788483203.934390:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1d7ea3d89ea1b8f5 00000004:00100000:0.0:1788483203.934407:0:17223:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788483203.934437:0:17223:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d32000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483203.934650:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875360098744064:12345-0@lo:38:llog_process_th.0 Request processed in 333us (5642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483203.934659:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788483203.934844:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69fd8f5500 x1875360098744064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483203.934856:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788483203.934865:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788483203.934872:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788483203.934876:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788483203.934879:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483203.934892:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098744064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788483203.936147:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098744576:0@lo:400:kworker.0 00000100:00100000:2.0:1788483203.936200:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.936232:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483203.936239:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098744448:0@lo:400:kworker.0 00000100:00100000:2.0:1788483203.936263:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.936314:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744576 00000100:00100000:2.0:1788483203.936320:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744576 00000100:00100000:2.0:1788483203.936360:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483203.936368:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098744576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483203.936410:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098744576:12345-0@lo:400:kworker.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.936417:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483203.936439:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744448 00000100:00100000:2.0:1788483203.936442:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744448 00000100:00100000:2.0:1788483203.936464:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788483203.936469:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098744448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483203.936698:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098744448:12345-0@lo:400:kworker.0 Request processed in 226us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.936705:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788483203.936737:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098744448:0@lo:400:kworker.0 00010000:00080000:2.0:1788483203.936749:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c5419f80 x1875360098744576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483203.936758:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098744576:0@lo:400:kworker.0 00000020:01000004:2.0:1788483203.937390:0:18750:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788483203.937404:0:18750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a69c76d4d28) 00000020:00000080:2.0:1788483203.937436:0:18750:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788483203.937692:0:18750:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69d0564000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788483203.937696:0:18750:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69d0564000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788483203.937699:0:18750:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d0564000 3 00010000:00080000:2.0:1788483203.937726:0:18750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69e011f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.154@tcp at head 00000100:00100000:3.0:1788483203.942556:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098744192:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.942626:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483203.942673:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483203.942680:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098744320:0@lo:400:kworker.0 00000100:00100000:3.0:1788483203.942705:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.942778:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744192 00000100:00100000:2.0:1788483203.942786:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744192 00000100:00100000:2.0:1788483203.942824:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788483203.942833:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098744192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483203.942884:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098744192:12345-0@lo:400:kworker.0 Request processed in 52us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.942891:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788483203.943065:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098744192:0@lo:400:kworker.0 00010000:00010000:2.0:1788483203.943319:0:18750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788483203.943484:0:18750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788483203.943519:0:18750:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788483203.943544:0:18750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1d7ea3d89ea1b903 00000100:00080000:2.0:1788483203.943550:0:18750:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483203.943554:0:18750:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a69e011f800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483203.943578:0:18750:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd936680 x1875360098744704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483203.943600:0:18750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788483203.943814:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483203.943818:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483203.943821:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483203.943824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483203.943827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483203.943836:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483203.943838:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483203.943841:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483203.944156:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098744704:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483203.944203:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788483203.944530:0:18750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788483203.944639:0:18724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788483203.944668:0:18724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788483203.944682:0:18724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.944692:0:18724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788483203.944741:0:18724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788483203.944743:0:18724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788483203.944744:0:18724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483203.944745:0:18724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483203.944747:0:18724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483203.944748:0:18724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483203.944749:0:18724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483203.944751:0:18724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483203.944752:0:18724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483203.944755:0:18724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788483203.944757:0:18724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788483203.944758:0:18724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788483203.944760:0:18724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483203.944761:0:18724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483203.944762:0:18724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483203.944763:0:18724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483203.944764:0:18724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483203.944765:0:18724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483203.944766:0:18724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483203.944782:0:18724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788483203.944794:0:18724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098744832:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788483203.944834:0:18724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.944863:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744832 00000100:00100000:2.0:1788483203.944868:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744832 00000100:00100000:2.0:1788483203.944900:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788483203.944908:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098744832:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483203.944929:0:17217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788483203.944942:0:17217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788483203.945326:0:18724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483203.946883:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744320 00000100:00100000:0.0:1788483203.946894:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744320 00000100:00100000:0.0:1788483203.946951:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744704 00000100:00100000:0.0:1788483203.946955:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744704 00000100:00100000:0.0:1788483203.946981:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483203.946990:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098744320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483203.947067:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098744320:12345-0@lo:400:kworker.0 Request processed in 79us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483203.947074:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788483203.947188:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483203.947194:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098744704:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788483203.947216:0:17222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1788483203.947249:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1d7ea3d89ea1b90a 00000004:00100000:3.0:1788483203.947263:0:17222:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788483203.947293:0:17222:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483203.947334:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875360098744704:12345-0@lo:38:llog_process_th.0 Request processed in 138us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483203.947340:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788483203.947400:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69c5418a80 x1875360098744320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483203.947414:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098744320:0@lo:400:kworker.0 00010000:00080000:1.0:1788483203.948276:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69fd936680 x1875360098744704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483203.948288:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788483203.948295:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788483203.948303:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788483203.948308:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788483203.948310:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e011f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483203.948315:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098744704:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788483203.952846:0:17217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788483203.952863:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788483203.953214:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:18724:x1875360098744832:12345-0@lo:253:mount.lustre.0 Request processed in 8301us (8374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483203.953226:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788483203.953299:0:18724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:18724:1875360098744832:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788483203.953312:0:18724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788483203.953315:0:18724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788483203.953317:0:18724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788483203.953318:0:18724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483203.953319:0:18724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483203.953320:0:18724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483203.953322:0:18724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483203.953323:0:18724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483203.953325:0:18724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483203.953326:0:18724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788483203.953340:0:18724:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788483203.954305:0:17238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788483203.954311:0:17238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788483203.954330:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.954344:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 20 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.954351:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 20 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.954358:0:17238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.954391:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 20 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.954404:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 20 pid: 17217 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483203.954417:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098744960:0@lo:104: 00000100:00100000:3.0:1788483203.954461:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788483203.957654:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 20 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483203.957673:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 20 pid: 17215 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483203.957706:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098745088:0@lo:104: 00000100:00100000:3.0:1788483203.957760:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483203.957785:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c30c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483203.957913:0:17206:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788483203.957932:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098744960 00000100:00100000:2.0:1788483203.957938:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098744960 00000100:00100000:2.0:1788483203.957981:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745088 00000100:00100000:2.0:1788483203.957984:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745088 00000100:00100000:2.0:1788483203.958000:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788483203.958008:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:17238:x1875360098744960:12345-0@lo:104: 00010000:00010000:2.0:1788483203.958020:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958070:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788483203.958076:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:17238:x1875360098744960:12345-0@lo:104: Request processed in 69us (3615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.958116:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788483203.958133:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483203.958140:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098745088:12345-0@lo:104: 00010000:00010000:2.0:1788483203.958147:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958181:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788483203.958192:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098745088:12345-0@lo:104: Request processed in 53us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.958197:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483203.958248:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098744960:0@lo:104: 00000100:00100000:2.0:1788483203.958257:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098745088:0@lo:104: 00010000:00010000:2.0:1788483203.958275:0:17238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958289:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483203.958295:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958301:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483203.958305:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958312:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483203.958319:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483203.958325:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788483203.958346:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958353:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483203.958370:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958387:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77800/0x1d7ea3d89ea1b862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b869 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958401:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483203.958404:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958410:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483203.958413:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958419:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483203.958426:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483203.958430:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788483203.958444:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958451:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483203.958457:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958463:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3e00/0x1d7ea3d89ea1b854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b85b expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958478:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483203.958485:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483203.958487:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483203.958493:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483203.958503:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098745216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483203.958532:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.958553:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483203.958559:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098745344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483203.958579:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483203.958607:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745216 00000100:00100000:2.0:1788483203.958611:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745216 00010000:00010000:2.0:1788483203.958627:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 21 pid: 17217 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483203.958645:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745344 00000100:00100000:2.0:1788483203.958648:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745344 00010000:00010000:2.0:1788483203.958659:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 22 pid: 17215 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483203.958671:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788483203.958677:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:3621:x1875360098745216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483203.958686:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483203.958692:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 22 pid: 17217 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958702:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 22 pid: 17217 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958715:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1b869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b862 expref: 22 pid: 17217 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958739:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483203.958766:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3621:x1875360098745216:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.958772:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788483203.958785:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483203.958791:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:3621:x1875360098745344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483203.958798:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483203.958802:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 20 pid: 17215 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958810:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 20 pid: 17215 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958820:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1b85b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b854 expref: 20 pid: 17215 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958831:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958839:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788483203.958851:0:17209:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015572219s 00010000:00010000:2.0:1788483203.958855:0:17209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958862:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958879:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958886:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958891:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483203.958895:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958903:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958915:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.958923:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483203.958947:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3621:x1875360098745344:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483203.958953:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483203.959001:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098745344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483203.959009:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098745216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483203.959026:0:17238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.959034:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483203.959050:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3800/0x1d7ea3d89ea1b911 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788483203.960259:0:18724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788483203.966237:0:18724:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788483203.966245:0:18724:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788483203.966275:0:18724:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788483203.966316:0:18724:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788483203.966331:0:18724:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788483203.966355:0:18724:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788483203.967773:0:18724:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788483203.967957:0:18724:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788483204.412520:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788483204.813540:0:18803:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483204.813758:0:18803:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788483205.048195:0:17219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788483205.048203:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c3dba000 from 9 10000000:01000000:0.0:1788483205.048207:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788483205.048252:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.048263:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.048285:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483205.048309:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483205.048367:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483205.048402:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483205.048428:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745472 00000100:00100000:0.0:1788483205.048435:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745472 00000100:00100000:0.0:1788483205.048475:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788483205.048484:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:17219:x1875360098745472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483205.048496:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483205.048508:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b918 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.048527:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 20 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.048536:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 20 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.048544:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8000, rc 0) 00000100:00100000:0.0:1788483205.048576:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:17219:x1875360098745472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483205.048582:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788483205.048622:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483205.048636:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.048651:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483205.048707:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788483205.048742:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483205.048765:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483205.049435:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745600 00000100:00100000:1.0:1788483205.049443:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745600 00000100:00100000:1.0:1788483205.049484:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788483205.049492:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:17219:x1875360098745600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788483205.049507:0:17217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788483205.049525:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788483205.049528:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788483205.049610:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:17219:x1875360098745600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483205.049621:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788483205.049755:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788483205.049811:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483205.049818:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.049825:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483205.049834:0:17219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788483205.049836:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69ece13000 from 9 10000000:01000000:0.0:1788483205.049838:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788483205.049857:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.049863:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.049870:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483205.049885:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483205.049921:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483205.049950:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483205.050478:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745728 00000100:00100000:1.0:1788483205.050486:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745728 00000100:00100000:1.0:1788483205.050518:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788483205.050526:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:17219:x1875360098745728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483205.050535:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483205.050547:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1b926 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483205.050566:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483205.050575:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483205.050582:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27e00, rc 0) 00000100:00100000:1.0:1788483205.050624:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098745728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483205.050631:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788483205.050643:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483205.050665:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.050675:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483205.050721:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788483205.050765:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483205.050795:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483205.051127:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745856 00000100:00100000:1.0:1788483205.051132:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745856 00000100:00100000:1.0:1788483205.051159:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788483205.051166:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098745856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788483205.051192:0:17216:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788483205.051210:0:17216:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788483205.051213:0:17216:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788483205.051282:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098745856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483205.051297:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788483205.051529:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098745856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788483205.051582:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483205.051589:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483205.051598:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483205.432362:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483205.893205:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483206.456213:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483207.480279:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483208.441835:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098745984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483208.441903:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483208.441945:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483208.441951:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098746112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483208.441973:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.442073:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098745984 00000100:00100000:0.0:1788483208.442081:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098745984 00000100:00100000:0.0:1788483208.442155:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098746112 00000100:00100000:0.0:1788483208.442159:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098746112 00000100:00100000:0.0:1788483208.442175:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483208.442183:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098745984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483208.442226:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483208.442272:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098745984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483208.442279:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483208.442295:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788483208.442302:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098746112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483208.442318:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483208.442347:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098746112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483208.442353:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788483208.442391:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098746112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483208.442403:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098745984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483208.507616:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483208.954399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483208.954405:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483208.954408:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483208.954411:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483208.954434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483208.954437:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483208.954440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483208.954443:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483208.954483:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098746240:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.954555:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.954598:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098746752:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.954627:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.954651:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788483208.954657:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098746368:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.954679:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.954697:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098746880:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.954721:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.954746:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098746496:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.954782:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.954800:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c541b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098747008:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.955192:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.955218:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483208.955225:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098746624:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.955252:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483208.955288:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098746240 00000100:00100000:0.0:1788483208.955295:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098746240 00000100:00100000:0.0:1788483208.955340:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788483208.955371:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098746752 00000100:00100000:3.0:1788483208.955378:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098746752 00000100:00100000:3.0:1788483208.955403:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098746880 00000100:00100000:3.0:1788483208.955405:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098746880 00000100:00100000:0.0:1788483208.955417:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3621:x1875360098746240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483208.955428:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098746496 00000100:00100000:3.0:1788483208.955432:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098746496 00000100:00100000:3.0:1788483208.955443:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747008 00000100:00100000:3.0:1788483208.955446:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747008 00000100:00100000:3.0:1788483208.955466:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483208.955475:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098746752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.955482:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3621:x1875360098746240:12345-0@lo:400:kworker.0 Request processed in 130us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483208.955491:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788483208.955524:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098746752:12345-0@lo:400:kworker.0 Request processed in 50us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483208.955529:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098746368 00000100:00100000:3.0:1788483208.955533:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483208.955535:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098746368 00000100:00100000:3.0:1788483208.955555:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483208.955564:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098746880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.955567:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098746624 00000100:00100000:0.0:1788483208.955571:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098746624 00000100:00100000:0.0:1788483208.955591:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788483208.955604:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098746880:12345-0@lo:400:kworker.0 Request processed in 37us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483208.955604:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098746368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483208.955614:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483208.955634:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788483208.955643:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098746496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.955655:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098746368:12345-0@lo:400:kworker.0 Request processed in 56us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483208.955663:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788483208.955678:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788483208.955685:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098746624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483208.955699:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098746496:12345-0@lo:400:kworker.0 Request processed in 56us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483208.955706:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483208.955721:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098746624:12345-0@lo:400:kworker.0 Request processed in 36us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483208.955726:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788483208.955732:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483208.955738:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098747008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483208.955770:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098747008:12345-0@lo:400:kworker.0 Request processed in 36us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483208.955776:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788483208.955806:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483208.955811:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483208.967452:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098746624:0@lo:400:kworker.0 00010000:00080000:0.0:1788483208.967475:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c541a300 x1875360098746496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483208.967485:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098746496:0@lo:400:kworker.0 00010000:00080000:0.0:1788483208.967496:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c541b480 x1875360098747008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483208.967504:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098747008:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.967566:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098746368:0@lo:400:kworker.0 00010000:00080000:0.0:1788483208.967580:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c541a680 x1875360098746880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483208.967589:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098746880:0@lo:400:kworker.0 00000100:00100000:0.0:1788483208.967600:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098746240:0@lo:400:kworker.0 00010000:00080000:0.0:1788483208.967611:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c5418380 x1875360098746752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483208.967647:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098746752:0@lo:400:kworker.0 00010000:00010000:1.0:1788483209.531366:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483210.553504:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483210.553871:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788483210.832520:0:19093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788483211.576448:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788483211.699889:0:19145:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483211.700475:0:19145:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788483212.154738:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483197/real 1788483197] req@ffff9a69c59e6300 x1875360098738944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483212.154766:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69c59e6300 x1875360098738944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483212 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483212.154775:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483197/real 1788483197] req@ffff9a69c59e5c00 x1875360098739072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483212.154786:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69c59e5c00 x1875360098739072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483212 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788483212.154805:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dc000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483212.154831:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788483212.154835:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098738944:0@lo:8:kworker.0 00000100:00080000:0.0:1788483212.154841:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483212.154846:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788483212.154849:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098739072:0@lo:8:kworker.0 00000100:00080000:3.0:1788483212.156435:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483212.156440:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483212.156443:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483212.156446:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483212.156459:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483212.156462:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788483212.156466:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dc000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483212.156473:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:3.0:1788483212.156478:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788483212.156485:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a69d25dc000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483212.156505:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3ec5f80 x1875360098747648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483212.156537:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483212.156541:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788483212.156543:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483212.156547:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:3.0:1788483212.156550:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788483212.156554:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69c2b8d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483212.156565:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3ec6d80 x1875360098747776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483212.157005:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098747136:0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157088:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.157141:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098747904:0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157166:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.157190:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483212.157195:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098747520:0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157217:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.157256:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098747264:0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157279:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.157297:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098748032:0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157317:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.157349:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788483212.157355:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098747392:0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157376:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.157409:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098748160:0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157429:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.157459:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747904 00000100:00100000:0.0:1788483212.157468:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747904 00000100:00100000:0.0:1788483212.157500:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748032 00000100:00100000:0.0:1788483212.157502:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748032 00000100:00100000:0.0:1788483212.157524:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747392 00000100:00100000:0.0:1788483212.157526:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747392 00000100:00100000:0.0:1788483212.157535:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748160 00000100:00100000:0.0:1788483212.157537:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748160 00000100:00100000:0.0:1788483212.157553:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788483212.157560:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098747904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157607:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098747904:12345-0@lo:400:kworker.0 Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.157613:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788483212.157629:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483212.157635:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098748032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157665:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098748032:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.157671:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483212.157690:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483212.157695:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098747392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157724:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098747392:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.157729:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483212.157740:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483212.157747:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098748160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157789:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098748160:12345-0@lo:400:kworker.0 Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.157796:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483212.157815:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747520 00000100:00100000:0.0:1788483212.157819:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747520 00000100:00100000:0.0:1788483212.157839:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747264 00000100:00100000:0.0:1788483212.157842:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747264 00000100:00100000:0.0:1788483212.157854:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788483212.157860:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098747520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157892:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098747520:12345-0@lo:400:kworker.0 Request processed in 32us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.157897:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788483212.157908:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788483212.157913:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c541a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098747264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483212.157939:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c541a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098747264:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.157945:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788483212.157972:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483212.157976:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483212.157992:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098747648:0@lo:8:kworker.0 00000100:00100000:0.0:1788483212.158031:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.158052:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098747776:0@lo:8:kworker.0 00000100:00100000:0.0:1788483212.158090:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483212.158144:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747648 00000100:00100000:0.0:1788483212.158148:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747648 00000100:00100000:0.0:1788483212.158162:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747776 00000100:00100000:0.0:1788483212.158164:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747776 00000100:00100000:0.0:1788483212.158173:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483212.158178:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1875360098747648:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788483212.158202:0:18729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788483212.158228:0:18729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1b934 00002000:00100000:0.0:1788483212.158241:0:18729:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a68c1d34000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788483212.158245:0:18729:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788483212.158248:0:18729:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788483212.158415:0:18729:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788483212.158439:0:18729:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d30800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483212.158479:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098747648:12345-0@lo:8:kworker.0 Request processed in 299us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.158487:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483212.158500:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483212.158504:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1875360098747776:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788483212.158516:0:18729:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788483212.160684:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098747136 00000100:00100000:3.0:1788483212.160698:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098747136 00000100:00100000:3.0:1788483212.160758:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788483212.160768:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3620:x1875360098747136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483212.160844:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3620:x1875360098747136:12345-0@lo:400:kworker.0 Request processed in 78us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483212.160851:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788483212.160952:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec4e00 x1875360098747392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.160966:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098747392:0@lo:400:kworker.0 00010000:00080000:3.0:1788483212.160984:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec5180 x1875360098748160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.160993:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098748160:0@lo:400:kworker.0 00000100:00100000:3.0:1788483212.161006:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098747264:0@lo:400:kworker.0 00010000:00080000:3.0:1788483212.161020:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec6a00 x1875360098748032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.161053:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098748032:0@lo:400:kworker.0 00000100:00100000:3.0:1788483212.161132:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098747520:0@lo:400:kworker.0 00000100:00100000:3.0:1788483212.161142:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098747136:0@lo:400:kworker.0 00010000:00080000:3.0:1788483212.161154:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec4380 x1875360098747904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.161162:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098747904:0@lo:400:kworker.0 00010000:00080000:3.0:1788483212.161189:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec5f80 x1875360098747648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.161198:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483212.161205:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788483212.161211:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788483212.161216:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788483212.161219:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788483212.161248:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788483212.161253:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098747648:0@lo:8:kworker.0 00000004:00080000:2.0:1788483212.161807:0:17964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788483212.161888:0:17964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 504424790948ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788483212.161896:0:17964:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788483212.162924:0:17965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788483212.162946:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17965:1875360098748416:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788483212.162999:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483212.163024:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d1b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483212.163062:0:18730:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788483212.163078:0:18730:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788483212.163243:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098748288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483212.163271:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483212.163322:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748416 00000100:00100000:1.0:1788483212.163329:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748416 00000100:00100000:1.0:1788483212.163434:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483212.163442:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17965:x1875360098748416:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1788483212.163645:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483212.164428:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748288 00000100:00100000:1.0:1788483212.164436:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748288 00000100:00100000:1.0:1788483212.164485:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483212.164494:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875360098748288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788483212.164517:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788483212.164581:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875360098748288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483212.164588:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788483212.164630:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd8f7480 x1875360098748288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483212.164663:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098748288:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1788483212.171809:0:17955:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788483212.173976:0:19165:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788483212.173985:0:19165:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788483212.174089:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17965:x1875360098748416:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10644us (11086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483212.174122:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788483212.174257:0:17965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd8f6300 x1875360098748416/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788483228 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.174270:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17965:1875360098748416:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788483212.174283:0:17965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788483212.174320:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17965:1875360098748544:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788483212.174353:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483212.174382:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483212.174431:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748544 00000100:00100000:1.0:1788483212.174437:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748544 00000100:00100000:1.0:1788483212.174508:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788483212.174517:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17965:x1875360098748544:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788483212.174539:0:18730:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788483212.174570:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17965:x1875360098748544:12345-0@lo:5:osp-pre-0-1.0 Request processed in 54us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483212.174577:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788483212.182875:0:17965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec5f80 x1875360098748544/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788483228 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.182894:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17965:1875360098748544:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788483212.182908:0:17965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788483212.182957:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17965:1875360098748672:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788483212.183015:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483212.183051:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483212.183880:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748672 00000100:00100000:3.0:1788483212.183889:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748672 00000100:00100000:3.0:1788483212.183938:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483212.183946:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17965:x1875360098748672:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788483212.183982:0:18731:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788483212.203834:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1875360098747776:12345-0@lo:8:kworker.0 Request processed in 45320us (45735us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483212.203848:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788483212.204259:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483212.204265:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788483212.204270:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098747776:0@lo:8:kworker.0 00000001:00080000:3.0:1788483212.226305:0:18725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788483212.226322:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788483212.226710:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17965:x1875360098748672:12345-0@lo:5:osp-pre-0-1.0 Request processed in 42758us (43689us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788483212.226732:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788483212.233324:0:17965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec5f80 x1875360098748672/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788483228 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483212.233340:0:17965:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788483212.233346:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17965:1875360098748672:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788483212.233362:0:17965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788483212.233422:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17965:1875360098748800:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788483212.233476:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483212.233568:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483212.240750:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748800 00000100:00100000:0.0:1788483212.240777:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748800 00000100:00100000:0.0:1788483212.240829:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483212.240839:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17965:x1875360098748800:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788483212.240942:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17965:x1875360098748800:12345-0@lo:900:osp-pre-0-1.0 Request processed in 103us (7463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483212.240949:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788483212.240991:0:17965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec5f80 x1875360098748800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788483228 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483212.241005:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17965:1875360098748800:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788483212.600310:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788483212.804664:0:19196:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788483212.804876:0:19196:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788483213.561345:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483213.561369:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098748928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483213.561434:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483213.561482:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098748928 00000100:00100000:0.0:1788483213.561488:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098748928 00000100:00100000:0.0:1788483213.561530:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788483213.561539:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098748928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483213.561570:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483213.561611:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098748928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483213.561618:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788483213.561662:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098748928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483213.561800:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483213.561810:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098749056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483213.561839:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483213.561869:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749056 00000100:00100000:3.0:1788483213.561872:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749056 00000100:00100000:3.0:1788483213.561894:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788483213.561899:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098749056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483213.561917:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788483213.561946:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098749056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483213.561952:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788483213.561979:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098749056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788483213.628686:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483214.648613:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483215.102018:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788483215.675185:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483216.705591:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483217.272535:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483197/real 1788483197] req@ffff9a69c59e6a00 x1875360098738560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483217 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483217.272576:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69c59e6a00 x1875360098738560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483217 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483217.272603:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483217.272620:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788483217.272625:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098738560:0@lo:8:kworker.0 00000100:00080000:0.0:1788483217.272781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483217.272802:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788483217.272805:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483217.272811:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1788483217.272817:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788483217.272825:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a69d18c9800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483217.272850:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c6231880 x1875360098749440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483217.272877:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483217.272881:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483217.272906:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483217.272909:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483217.272910:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483217.272914:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 504 00000100:00080000:0.0:1788483217.272917:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788483217.272920:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69c2b8d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483217.272931:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c6230a80 x1875360098749952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483217.272979:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098749312:0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273072:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483217.273175:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098750080:0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273206:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483217.273230:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788483217.273236:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098749568:0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273257:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483217.273284:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098750208:0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273307:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483217.273344:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749312 00000100:00100000:0.0:1788483217.273354:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749312 00000100:00100000:0.0:1788483217.273410:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788483217.273420:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098749312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273498:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098749312:12345-0@lo:400:kworker.0 Request processed in 78us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483217.273506:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788483217.273534:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750080 00000100:00100000:0.0:1788483217.273539:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750080 00000100:00100000:0.0:1788483217.273563:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749568 00000100:00100000:0.0:1788483217.273566:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749568 00000100:00100000:0.0:1788483217.273578:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750208 00000100:00100000:0.0:1788483217.273581:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750208 00000100:00100000:0.0:1788483217.273608:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788483217.273615:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098750080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273648:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098750080:12345-0@lo:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483217.273654:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788483217.273667:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788483217.273674:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098749568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273702:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098749568:12345-0@lo:400:kworker.0 Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483217.273707:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788483217.273718:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788483217.273723:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098750208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.273762:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098750208:12345-0@lo:400:kworker.0 Request processed in 39us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483217.273768:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788483217.273811:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098749440:0@lo:8:kworker.0 00000100:00100000:0.0:1788483217.273843:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483217.273871:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098749952:0@lo:8:kworker.0 00000100:00100000:0.0:1788483217.273893:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788483217.274021:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c6231f80 x1875360098749568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483217.274036:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098749568:0@lo:400:kworker.0 00010000:00080000:0.0:1788483217.274058:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c6233100 x1875360098750208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483217.274067:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098750208:0@lo:400:kworker.0 00000100:00100000:0.0:1788483217.274079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098749312:0@lo:400:kworker.0 00010000:00080000:0.0:1788483217.274087:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c6231500 x1875360098750080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483217.274123:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098750080:0@lo:400:kworker.0 00000100:00100000:1.0:1788483217.274580:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098749696:0@lo:400:kworker.0 00000100:00100000:1.0:1788483217.274628:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483217.274658:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098750336:0@lo:400:kworker.0 00000100:00100000:1.0:1788483217.274683:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483217.274706:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788483217.274712:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098749184:0@lo:400:kworker.0 00000100:00100000:1.0:1788483217.274741:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483217.274766:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098749824:0@lo:400:kworker.0 00000100:00100000:1.0:1788483217.274788:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788483217.274814:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483217.274840:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749440 00000100:00100000:1.0:1788483217.274845:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749440 00000100:00100000:1.0:1788483217.274884:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749952 00000100:00100000:1.0:1788483217.274887:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749952 00000100:00100000:1.0:1788483217.274896:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749824 00000100:00100000:1.0:1788483217.274899:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749824 00000100:00100000:1.0:1788483217.274930:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483217.274938:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098749824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483217.274988:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098749824:12345-0@lo:400:kworker.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483217.274994:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483217.275009:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788483217.275013:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098749440:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788483217.275056:0:18730:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1788483217.275118:0:18730:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1b93b 00002000:00100000:1.0:1788483217.275139:0:18730:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a68c3319800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788483217.275144:0:18730:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788483217.275157:0:18730:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788483217.275257:0:18730:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788483217.275284:0:18730:0:(import.c:65:import_set_state_nolock()) ffff9a68c331c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483217.275326:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098749440:12345-0@lo:8:kworker.0 Request processed in 311us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483217.275332:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788483217.275345:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788483217.275349:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098749952:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788483217.275361:0:18730:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788483217.277733:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749184 00000100:00100000:2.0:1788483217.277753:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749184 00000100:00100000:2.0:1788483217.277820:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788483217.277833:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3621:x1875360098749184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483217.277938:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3621:x1875360098749184:12345-0@lo:400:kworker.0 Request processed in 108us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483217.277961:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788483217.278011:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098749696 00000100:00100000:2.0:1788483217.278016:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098749696 00000100:00100000:2.0:1788483217.278060:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788483217.278068:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098749696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483217.278134:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098749696:12345-0@lo:400:kworker.0 Request processed in 68us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483217.278141:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788483217.278167:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750336 00000100:00100000:2.0:1788483217.278172:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750336 00000100:00100000:2.0:1788483217.278205:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788483217.279785:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098750336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483217.279871:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098750336:12345-0@lo:400:kworker.0 Request processed in 107us (5187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483217.279879:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788483217.282717:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483217.282731:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483217.282805:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098749184:0@lo:400:kworker.0 00010000:00080000:2.0:1788483217.282841:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c6232d80 x1875360098749824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483217.282857:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098749824:0@lo:400:kworker.0 00000100:00100000:2.0:1788483217.282872:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098749696:0@lo:400:kworker.0 00010000:00080000:2.0:1788483217.282890:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c6230700 x1875360098750336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483217.282899:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098750336:0@lo:400:kworker.0 00010000:00080000:2.0:1788483217.287275:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c6231880 x1875360098749440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483217.287296:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788483217.287309:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788483217.287321:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788483217.287330:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788483217.287468:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788483217.287500:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788483217.287508:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098749440:0@lo:8:kworker.0 00000004:00080000:0.0:1788483217.289428:0:17247:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788483217.289465:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17247:1875360098750592:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788483217.289564:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483217.289611:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdf6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483217.289644:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750592 00000100:00100000:0.0:1788483217.289652:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750592 00000100:00100000:0.0:1788483217.289746:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483217.289756:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17247:x1875360098750592:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788483217.290485:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483217.290515:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483217.290535:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098750464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483217.290588:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788483217.291506:0:17246:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788483217.291654:0:17246:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 509554557300ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788483217.291664:0:17246:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:0.0:1788483217.298469:0:19165:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788483217.298490:0:19165:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788483217.298499:0:19165:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:1.0:1788483217.320494:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750464 00000100:00100000:1.0:1788483217.320528:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750464 00000004:00080000:2.0:1788483217.323508:0:17202:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788483217.331351:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788483217.331381:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098750464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788483217.331429:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788483217.331554:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098750464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (40965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483217.331562:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788483217.331744:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c6231500 x1875360098750464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483217.331769:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098750464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483217.332553:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098749952:12345-0@lo:8:kworker.0 Request processed in 57197us (58652us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483217.332567:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788483217.332617:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483217.332623:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788483217.332627:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098749952:0@lo:8:kworker.0 00002000:00010000:0.0:1788483217.344949:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.344972:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345003:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.345010:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.345085:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345138:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345268:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345278:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345333:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483217.345359:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483217.345367:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345377:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.345382:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345394:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345415:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345424:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b942 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.345447:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.345449:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.345451:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.355475:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.355497:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.355520:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.355526:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.355535:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.355555:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.355577:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.355586:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.355621:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483217.355970:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483217.355981:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.355991:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.356004:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.356027:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.356059:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.356068:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b949 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.356093:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.356130:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.356132:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.356800:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.356809:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.356821:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.356825:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.356830:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.356841:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.356849:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.356857:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.357130:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483217.359341:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.359360:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.359379:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.359384:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.359391:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.359407:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.359417:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.359425:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.360770:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483217.360787:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.360801:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.360807:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.360819:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.360844:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.360949:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b950 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.360978:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483217.360983:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.360990:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.360993:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.361001:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.361110:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.361121:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.361123:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.361126:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483217.361437:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788483217.361448:0:19165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b957 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.361571:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.374167:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.374183:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374207:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.374223:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.374231:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374250:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374262:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374270:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374293:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483217.374306:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483217.374313:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374322:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.374327:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374337:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374357:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374379:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1962c/0x1d7ea3d89ea1b95e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374398:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.374400:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.374402:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.374948:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.374956:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374967:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.374972:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.374976:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374987:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.374995:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375002:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375030:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483217.375049:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483217.375061:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375069:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.375072:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375081:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375118:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375127:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026d93042/0x1d7ea3d89ea1b965 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375142:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.375143:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.375156:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.375604:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.375611:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375620:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.375623:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.375627:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375648:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375658:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375665:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375680:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483217.375690:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483217.375694:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375701:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.375704:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375712:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375724:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375731:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1b96c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.375751:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.375752:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.375754:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.376207:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.376215:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376225:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.376229:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.376233:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376245:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376253:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376260:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376278:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483217.376285:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483217.376290:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376308:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483217.376311:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376318:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376329:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376335:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1b973 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.376349:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.376351:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.376353:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.378075:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.378092:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.378134:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.378139:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.378236:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.378253:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.378276:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.378284:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.378311:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.378828:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.378841:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.378868:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.378873:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.378883:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.378907:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.378915:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1b97a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.378943:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.378945:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.378947:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.380368:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.380385:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.380403:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.380409:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.380416:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.380431:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.380442:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.380451:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.380531:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483217.386270:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.386291:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.386316:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.386321:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.386329:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.386348:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.386360:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.386367:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386629:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483217.386638:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386664:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483217.386669:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386679:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386700:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386707:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1b981 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386825:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483217.386830:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386836:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483217.386840:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386848:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386860:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.386876:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483217.386877:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483217.386879:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.389326:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788483217.389342:0:19165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b988 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.389536:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.391394:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.391412:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.391433:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.391439:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.391447:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.391462:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.391474:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.391483:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.391509:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483217.393262:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483217.393279:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.393296:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483217.393302:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.393315:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.393344:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.393371:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1b98f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.393396:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.393398:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.393400:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.393456:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.393464:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.393487:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.393492:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.393498:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.393511:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.393520:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.393528:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.393554:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.393727:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.393736:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.393747:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.393751:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.393761:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.393783:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.393791:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ddd3f0d/0x1d7ea3d89ea1b996 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.393807:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.393808:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.393811:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.395468:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.395486:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.395506:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.395511:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.395518:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.395532:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.395562:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.395570:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.395598:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483217.401222:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483217.401242:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.401260:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483217.401266:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.401279:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.401307:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.401316:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007697862e/0x1d7ea3d89ea1b99d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.401341:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.401343:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.401345:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.401569:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.401580:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.401595:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.401601:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.401609:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.401623:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.401633:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.401642:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.401680:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.401699:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.401708:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.401719:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.401723:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.401733:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.401746:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.401755:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1b9a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.401786:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.401788:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.401790:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.402547:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.402555:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.402565:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.402568:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.402573:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.402583:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.402590:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.402597:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.402618:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483217.402860:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483217.402867:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.402876:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483217.402879:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.402887:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.402900:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.402908:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1b9ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.402927:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.402928:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.402930:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.403305:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.403312:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403321:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.403331:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.403337:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403348:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403356:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403364:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403385:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.403646:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.403652:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.403662:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.403666:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.403674:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.403685:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.403693:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6ab417/0x1d7ea3d89ea1b9b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.403710:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.403712:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.403714:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.403787:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.403793:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403802:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.403805:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.403809:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403819:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403828:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403842:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.403864:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483217.404273:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483217.404280:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.404290:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483217.404294:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.404315:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.404328:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.404336:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1b9b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.404352:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.404354:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.404355:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.406591:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.406612:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.406635:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.406639:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.406646:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.406661:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.406673:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.406681:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.406708:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.408320:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.408346:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408391:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.408396:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408408:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408433:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408441:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1b9c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408468:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.408471:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.408473:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.408572:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.408583:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.408603:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.408609:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.408616:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.408630:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.408639:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.408648:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.408680:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.408705:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.408711:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408719:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.408722:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408814:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408855:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408864:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000445ba748/0x1d7ea3d89ea1b9c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.408899:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.408903:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.408907:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.411779:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.411801:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.411823:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.411828:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.411836:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.411854:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.411891:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.411900:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.411931:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.412011:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.412025:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.412038:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.412052:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.412062:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.412084:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.412091:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005abc33e8/0x1d7ea3d89ea1b9ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.412162:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.412164:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.412166:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.413308:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.413321:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.413336:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.413341:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.413347:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.413360:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.413370:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.413378:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.413418:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.413586:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.413601:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.413614:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ae00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.413620:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.413632:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.413651:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.413659:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f15e2f5a/0x1d7ea3d89ea1b9d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.413689:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.413691:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.413693:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483217.414006:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483217.414027:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.414037:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788483217.414050:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483217.414055:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.414065:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.414075:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.414083:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.414128:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483217.414189:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483217.414197:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.414226:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483217.414230:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.414239:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.414252:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.414260:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1b9dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483217.414277:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.414279:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483217.414280:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.415659:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.415676:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.415708:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.415713:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.415720:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.415734:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.415744:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.415752:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.415779:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483217.416980:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.416994:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.417009:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.417025:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.417031:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.417055:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.417083:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.417091:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.417122:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788483217.417326:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483217.417336:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417346:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483217.417360:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417371:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417393:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417401:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1b9e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417426:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483217.417430:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417438:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483217.417442:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417449:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417459:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417466:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1b9ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483217.417489:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483217.417491:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483217.417493:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483217.422391:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483217.422413:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.422416:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483217.422435:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788483217.422440:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483217.422448:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.422470:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.422482:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.422492:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483217.422551:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483217.424750:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483217.424770:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.424786:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483217.424793:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.424806:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.424834:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.424862:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1b9f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.424897:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.424900:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.424902:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483217.425460:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483217.425469:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.425485:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788483217.425490:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483217.425498:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.425513:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.425523:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.425531:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.425553:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483217.426123:0:19165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483217.426137:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426148:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788483217.426151:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483217.426156:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426167:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426175:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426183:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426200:0:19165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788483217.426214:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483217.426220:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426228:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483217.426232:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426241:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426262:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426269:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace386de/0x1d7ea3d89ea1b9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426285:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483217.426288:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426294:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483217.426297:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426304:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426312:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426319:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b85281bf/0x1d7ea3d89ea1b9ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483217.426328:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.426330:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.426336:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483217.426344:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788483217.426389:0:19165:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788483217.426507:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17247:x1875360098750592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 136746us (136937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483217.426523:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483217.426774:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17247:1875360098750592:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788483217.426796:0:17247:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788483217.426853:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17247:1875360098750720:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788483217.426897:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483217.426934:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483217.428347:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750720 00000100:00100000:2.0:1788483217.428363:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750720 00000100:00100000:2.0:1788483217.428437:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788483217.428448:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17247:x1875360098750720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788483217.428509:0:18729:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1788483217.441905:0:18725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788483217.441953:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788483217.447224:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17247:x1875360098750720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18772us (20321us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788483217.447238:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788483217.447430:0:17247:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788483217.447439:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17247:1875360098750720:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788483217.447456:0:17247:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1788483217.657283:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098750848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483217.657355:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483217.665541:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750848 00000100:00100000:3.0:1788483217.665555:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750848 00000100:00100000:3.0:1788483217.665723:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483217.665734:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098750848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483217.665761:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483217.671868:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098750848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6128us (14504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483217.671892:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483217.672306:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098750848:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483217.726633:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483218.296163:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483198/real 1788483198] req@ffff9a69fd935880 x1875360098740224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483218.296194:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69fd935880 x1875360098740224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483218.296214:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483218.296236:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788483218.296240:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098740224:0@lo:8:kworker.0 00000100:00080000:3.0:1788483218.296829:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483218.296834:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788483218.296837:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483218.296843:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1788483218.296847:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788483218.296854:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69efd93800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483218.296872:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3ec4e00 x1875360098751360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483218.296904:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483218.296908:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788483218.296909:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483218.296912:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:3.0:1788483218.296915:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788483218.296918:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69c2b8d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483218.296928:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3ec7b80 x1875360098751872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483218.296970:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098751232:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297028:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483218.297069:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098752000:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297113:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483218.297136:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788483218.297142:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098751104:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297177:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483218.297195:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098751744:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297215:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483218.297246:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752000 00000100:00100000:3.0:1788483218.297253:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752000 00000100:00100000:3.0:1788483218.297296:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788483218.297304:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098752000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297352:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098752000:12345-0@lo:400:kworker.0 Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483218.297359:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788483218.297381:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098751104 00000100:00100000:3.0:1788483218.297386:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098751104 00000100:00100000:3.0:1788483218.297411:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483218.297418:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098751104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297449:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098751104:12345-0@lo:400:kworker.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483218.297455:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483218.297477:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098751360:0@lo:8:kworker.0 00000100:00100000:3.0:1788483218.297502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483218.297528:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098751872:0@lo:8:kworker.0 00000100:00100000:3.0:1788483218.297546:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483218.297571:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098751232 00000100:00100000:3.0:1788483218.297575:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098751232 00000100:00100000:3.0:1788483218.297594:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098751744 00000100:00100000:3.0:1788483218.297597:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098751744 00000100:00100000:3.0:1788483218.297608:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098751360 00000100:00100000:3.0:1788483218.297610:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098751360 00000100:00100000:3.0:1788483218.297627:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098751872 00000100:00100000:3.0:1788483218.297630:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098751872 00000100:00100000:3.0:1788483218.297639:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483218.297645:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098751232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297676:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098751232:12345-0@lo:400:kworker.0 Request processed in 32us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483218.297682:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483218.297694:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483218.297700:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098751744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297724:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098751744:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483218.297729:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483218.297739:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483218.297742:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098751360:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788483218.297758:0:18731:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788483218.297787:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098751360:12345-0@lo:8:kworker.0 Request processed in 43us (285us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483218.297793:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483218.297803:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483218.297806:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098751872:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788483218.297816:0:18731:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788483218.297838:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098751872:12345-0@lo:8:kworker.0 Request processed in 30us (291us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483218.297843:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788483218.297874:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483218.297878:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788483218.297888:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098751360:0@lo:8:kworker.0 00000100:00080000:3.0:1788483218.297899:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483218.297902:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788483218.297904:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098751872:0@lo:8:kworker.0 00000100:00100000:3.0:1788483218.297933:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098751104:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297958:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098751744:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.297968:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098751232:0@lo:400:kworker.0 00010000:00080000:3.0:1788483218.297977:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec6680 x1875360098752000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483218.297985:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098752000:0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298436:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098750976:0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298478:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483218.298500:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098751616:0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298522:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483218.298541:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098752256:0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298562:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483218.298588:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788483218.298594:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098751488:0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298614:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483218.298632:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098752128:0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298650:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483218.298678:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098751616 00000100:00100000:1.0:1788483218.298681:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098751616 00000100:00100000:1.0:1788483218.298727:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788483218.298733:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098751616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298768:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098751616:12345-0@lo:400:kworker.0 Request processed in 36us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483218.298774:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788483218.298794:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752256 00000100:00100000:1.0:1788483218.298798:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752256 00000100:00100000:1.0:1788483218.298814:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098751488 00000100:00100000:1.0:1788483218.298816:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098751488 00000100:00100000:1.0:1788483218.298827:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752128 00000100:00100000:1.0:1788483218.298829:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752128 00000100:00100000:1.0:1788483218.298840:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788483218.298845:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098752256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298872:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098752256:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483218.298878:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788483218.298889:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788483218.298894:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098751488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298916:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098751488:12345-0@lo:400:kworker.0 Request processed in 22us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483218.298921:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788483218.298930:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483218.298934:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098752128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.298955:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098752128:12345-0@lo:400:kworker.0 Request processed in 21us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483218.298960:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788483218.298985:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec5880 x1875360098751488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483218.299000:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098751488:0@lo:400:kworker.0 00010000:00080000:1.0:1788483218.299011:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3ec7480 x1875360098752128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483218.299019:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098752128:0@lo:400:kworker.0 00000100:00100000:1.0:1788483218.299028:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098751616:0@lo:400:kworker.0 00010000:00080000:1.0:1788483218.299048:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e6a00 x1875360098752256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483218.299056:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098752256:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.300537:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098750976 00000100:00100000:3.0:1788483218.300549:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098750976 00000100:00100000:3.0:1788483218.302106:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788483218.302124:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3620:x1875360098750976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.302226:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3620:x1875360098750976:12345-0@lo:400:kworker.0 Request processed in 107us (3746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483218.302233:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788483218.305448:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098750976:0@lo:400:kworker.0 00000100:00100000:3.0:1788483218.680234:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098752384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483218.680302:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483218.680354:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752384 00000100:00100000:3.0:1788483218.680361:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752384 00000100:00100000:3.0:1788483218.680405:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788483218.680415:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098752384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483218.680460:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788483218.680507:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098752384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483218.680514:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788483218.680560:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098752384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483218.686708:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098752512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483218.686776:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483218.686875:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752512 00000100:00100000:2.0:1788483218.686883:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752512 00000100:00100000:2.0:1788483218.686932:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788483218.686941:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098752512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483218.686983:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788483218.687030:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098752512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483218.687056:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788483218.687400:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098752512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788483218.748006:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483219.768216:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788483220.685506:0:19541:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788483220.685510:0:19541:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788483220.685512:0:19541:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788483220.685627:0:19541:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a68c331b000 00000020:01000004:1.0:1788483220.685643:0:19541:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788483220.685657:0:19541:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788483220.685670:0:19541:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a69e00999b8) 00000020:00000080:1.0:1788483220.685687:0:19541:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788483220.777399:0:19541:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788483220.781552:0:19541:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788483220.782164:0:19541:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788483220.782467:0:19541:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788483220.782691:0:19541:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788483220.782915:0:19541:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788483220.783496:0:19541:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788483220.784540:0:19541:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788483220.784730:0:19541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788483220.784743:0:19541:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483220.784755:0:19541:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d7ea3d89ea1ba0d 00000020:01000004:3.0:1788483220.784760:0:19541:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788483220.784780:0:19541:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788483220.784783:0:19541:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788483220.784790:0:19541:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788483220.784828:0:19541:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788483220.784833:0:19541:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:00080000:1.0:1788483220.793901:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788483220.794295:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788483220.805697:0:19541:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788483220.805735:0:19541:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.154@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788483220.805740:0:19541:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788483220.805741:0:19541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788483220.805743:0:19541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483220.805744:0:19541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483220.805745:0:19541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483220.805746:0:19541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483220.805748:0:19541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483220.805749:0:19541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483220.805751:0:19541:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788483220.805758:0:19541:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788483220.805760:0:19541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788483220.805761:0:19541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788483220.805762:0:19541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483220.805763:0:19541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483220.805764:0:19541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483220.805765:0:19541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483220.805766:0:19541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483220.805767:0:19541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483220.805768:0:19541:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788483220.805791:0:19541:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788483220.805808:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098752640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788483220.805867:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.805951:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788483220.806489:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752640 00000100:00100000:3.0:1788483220.806586:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752640 00000100:00100000:2.0:1788483220.808969:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788483220.808983:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:19541:x1875360098752640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483220.809051:0:17215:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788483220.809056:0:17215:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788483220.809059:0:17215:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788483220.810831:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:19541:x1875360098752640:12345-0@lo:253:mount.lustre.0 Request processed in 1845us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483220.810843:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788483220.810950:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098752640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788483220.810965:0:19541:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788483220.810968:0:19541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788483220.810969:0:19541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788483220.810970:0:19541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483220.810972:0:19541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483220.810973:0:19541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483220.810974:0:19541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483220.810975:0:19541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483220.810977:0:19541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483220.810978:0:19541:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788483220.811014:0:19541:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a68c331b000 from lustre-OST0001 10000000:01000000:1.0:1788483220.811057:0:19541:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788483220.811060:0:19541:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788483220.811068:0:19541:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69edaa0000 local copy 00010000:00010000:1.0:1788483220.811078:0:19541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483220.811376:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098752768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483220.811415:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.811503:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483220.812719:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752768 00000100:00100000:3.0:1788483220.812729:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752768 00000100:00100000:3.0:1788483220.812820:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788483220.812830:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:19541:x1875360098752768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483220.812949:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:19541:x1875360098752768:12345-0@lo:501:mount.lustre.0 Request processed in 119us (1532us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788483220.812956:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788483220.813057:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098752768:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788483220.813089:0:19541:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788483220.813135:0:19541:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788483220.813144:0:19541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483220.813154:0:19541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483220.813199:0:19541:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a68c331b000 10000000:01000000:0.0:1788483220.813204:0:19541:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788483220.813210:0:19541:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788483220.813226:0:19541:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788483220.813231:0:19541:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788483220.813233:0:19541:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788483220.813259:0:19541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483220.813267:0:19541:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483220.813275:0:19541:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483220.813294:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098752896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483220.813340:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483220.813952:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483220.816541:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098752896 00000100:00100000:1.0:1788483220.816554:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098752896 00000100:00100000:1.0:1788483220.816608:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788483220.816617:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:19541:x1875360098752896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483220.816632:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483220.816647:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1ba1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1ba14 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483220.816675:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1ba1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba14 expref: 22 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483220.816685:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1ba1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba14 expref: 22 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483220.816693:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b800, rc 0) 00000100:00100000:1.0:1788483220.816756:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098752896:12345-0@lo:101:mount.lustre.0 Request processed in 140us (3415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483220.816762:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788483220.817306:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098752896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483220.817337:0:19541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483220.817348:0:19541:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483220.820433:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788483220.822591:0:19541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788483220.828441:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788483220.828501:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788483220.828516:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788483220.828528:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788483220.828541:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788483220.828554:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788483220.828784:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788483220.828796:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788483220.828903:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483220.830263:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483220.830382:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788483220.830583:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753024 00000100:00100000:1.0:1788483220.830593:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753024 00000100:00100000:1.0:1788483220.830649:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788483220.830660:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483220.830822:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753024:12345-0@lo:501:mount.lustre.0 Request processed in 164us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483220.830829:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788483220.831064:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483220.831146:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483220.831400:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483220.831420:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483220.831491:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753152 00000100:00100000:2.0:1788483220.831496:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753152 00000100:00100000:2.0:1788483220.831527:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788483220.831534:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753152:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483220.832685:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753152:12345-0@lo:503:mount.lustre.0 Request processed in 1147us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483220.832695:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788483220.833047:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753152:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788483220.834003:0:19541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483220.834131:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483220.835065:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483220.835147:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483220.835511:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753280 00000100:00100000:3.0:1788483220.835519:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753280 00000100:00100000:3.0:1788483220.835568:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788483220.835577:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483220.836312:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753280:12345-0@lo:502:mount.lustre.0 Request processed in 734us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.836333:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788483220.836578:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483220.836797:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788483220.836830:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788483220.836850:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788483220.836867:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788483220.836884:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788483220.836898:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788483220.836911:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788483220.836924:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788483220.837288:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788483220.837478:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483220.837548:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483220.837640:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69eda8f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483220.842708:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753408 00000100:00100000:2.0:1788483220.842723:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753408 00000100:00100000:3.0:1788483220.842909:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788483220.842920:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483220.844541:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483220.844638:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788483220.844655:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000100:00100000:3.0:1788483220.845357:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753408:12345-0@lo:502:mount.lustre.0 Request processed in 2434us (7804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.845367:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000020:01000000:0.0:1788483220.847120:0:19545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788483220.847131:0:19545:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788483220.847138:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483220.847140:0:19545:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788483220.847146:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788483220.847184:0:19545:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a68c44019b8) 00000020:00000080:0.0:1788483220.847211:0:19545:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788483220.847218:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788483220.847295:0:19545:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c331b000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788483220.847305:0:19545:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788483220.847324:0:19545:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d7ea3d89ea1ba29 00010000:00010000:0.0:1788483220.851827:0:19545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788483220.853230:0:19545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788483220.855679:0:19545:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788483220.857917:0:19545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788483220.857943:0:19545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483220.857955:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483220.857957:0:19545:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788483220.857961:0:19545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483220.857965:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483220.857966:0:19545:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788483220.857969:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788483220.857971:0:19545:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788483220.857973:0:19545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483220.857976:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483220.857977:0:19545:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788483220.857979:0:19545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483220.857981:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483220.857982:0:19545:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788483220.857986:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788483220.858034:0:19545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483220.858038:0:19545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483220.858039:0:19545:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788483220.858042:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788483220.865030:0:19541:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788483220.865085:0:19541:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788483220.865126:0:19541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483220.865138:0:19541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483220.865147:0:19541:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c331b000 from 1 10000000:01000000:2.0:1788483220.865150:0:19541:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788483220.865183:0:19541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483220.865191:0:19541:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483220.865210:0:19541:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483220.865233:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483220.865292:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483220.865340:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483220.865998:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753536 00000100:00100000:2.0:1788483220.866006:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753536 00000100:00100000:2.0:1788483220.866066:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788483220.866086:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:19541:x1875360098753536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483220.866116:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483220.866130:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1ba30 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483220.866153:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483220.866163:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483220.866172:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76e00, rc 0) 00000100:00100000:2.0:1788483220.866219:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098753536:12345-0@lo:101:mount.lustre.0 Request processed in 135us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483220.866226:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788483220.866271:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483220.866284:0:19541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483220.866300:0:19541:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483220.867833:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788483220.875730:0:19541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483220.875960:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788483220.875985:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788483220.876014:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788483220.876030:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788483220.876147:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483220.876208:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.876246:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483220.876544:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753664 00000100:00100000:0.0:1788483220.876551:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753664 00000100:00100000:0.0:1788483220.876595:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788483220.876605:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098753664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483220.876716:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098753664:12345-0@lo:501:mount.lustre.0 Request processed in 113us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483220.876724:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788483220.876834:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483220.876865:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483220.876909:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.876941:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483220.877086:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753792 00000100:00100000:0.0:1788483220.877091:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753792 00000100:00100000:0.0:1788483220.877143:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788483220.877150:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098753792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483220.877227:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098753792:12345-0@lo:503:mount.lustre.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483220.877240:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788483220.877331:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753792:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788483220.877656:0:19541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788483220.877715:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483220.877751:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.877782:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483220.877797:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098753920 00000100:00100000:1.0:1788483220.877801:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098753920 00000100:00100000:1.0:1788483220.877821:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788483220.877828:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098753920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483220.877898:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098753920:12345-0@lo:502:mount.lustre.0 Request processed in 69us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483220.877905:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788483220.877949:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098753920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483220.878381:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788483220.878410:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788483220.878425:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788483220.878438:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788483220.878450:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788483220.878463:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788483220.878476:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788483220.878490:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788483220.878503:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788483220.878516:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788483220.878530:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788483220.878556:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483220.878599:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.878609:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483220.878633:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754048 00000100:00100000:1.0:1788483220.878642:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754048 00000100:00100000:1.0:1788483220.878674:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788483220.878681:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098754048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483220.878757:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098754048:12345-0@lo:502:mount.lustre.0 Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483220.878763:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788483220.878798:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483220.878832:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788483220.878840:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788483220.880922:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483220.881269:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.881273:0:19549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788483220.881280:0:19549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c331b000 00000020:00000080:3.0:1788483220.881283:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483220.881291:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483220.881300:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.881302:0:19549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788483220.881305:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483220.881308:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.881309:0:19549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788483220.881376:0:19549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c331b000 00000020:00000080:3.0:1788483220.881380:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483220.881466:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483220.881470:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.881472:0:19549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788483220.881475:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483220.881478:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.881479:0:19549:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483220.881483:0:19549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c331b000 00000020:00000080:3.0:1788483220.881485:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483220.882233:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483220.882240:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.882241:0:19549:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483220.882245:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483220.882248:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.882249:0:19549:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788483220.882254:0:19549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c331b000 00000020:00000080:3.0:1788483220.882257:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483220.882292:0:19549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483220.882295:0:19549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483220.882296:0:19549:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788483220.882300:0:19549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788483220.889795:0:19541:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788483220.889848:0:19541:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483220.889871:0:19541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483220.889884:0:19541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483220.890086:0:19541:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788483220.890090:0:19541:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a68c331b000 10000000:01000000:1.0:1788483220.890093:0:19541:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a68c331b000 10000000:01000000:1.0:1788483220.890189:0:19541:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788483220.890196:0:19541:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68c331b000 from 1 10000000:01000000:1.0:1788483220.890199:0:19541:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788483220.890291:0:19541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483220.890300:0:19541:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483220.890330:0:19541:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483220.890354:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483220.890420:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.890462:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483220.897198:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754176 00000100:00100000:0.0:1788483220.897210:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754176 00000100:00100000:0.0:1788483220.897262:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788483220.897273:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:19541:x1875360098754176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483220.897290:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483220.897307:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6a021c6800/0x1d7ea3d89ea1ba45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1ba3e expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483220.897404:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6a021c6800/0x1d7ea3d89ea1ba45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba3e expref: 24 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483220.897416:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6a021c6800/0x1d7ea3d89ea1ba45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba3e expref: 24 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483220.897426:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6800, rc 0) 00000100:00100000:0.0:1788483220.897508:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754176:12345-0@lo:101:mount.lustre.0 Request processed in 236us (7087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483220.897516:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788483220.897527:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483220.897547:0:19541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483220.897559:0:19541:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483220.917265:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788483220.917580:0:19541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483220.917773:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788483220.917800:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788483220.917817:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788483220.917832:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788483220.917846:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788483220.917859:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788483220.917871:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788483220.917882:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788483220.917894:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788483220.917933:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788483220.917950:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788483220.917963:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788483220.917977:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788483220.917987:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788483220.918010:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788483220.918037:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788483220.918053:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788483220.918065:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788483220.918077:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788483220.918090:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788483220.918133:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788483220.918150:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788483220.918167:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788483220.918183:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788483220.918198:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788483220.918227:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788483220.918244:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788483220.918257:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788483220.918270:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788483220.918282:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788483220.918293:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788483220.918304:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788483220.918315:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788483220.918326:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788483220.918337:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788483220.918348:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788483220.918358:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788483220.918371:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788483220.918383:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788483220.918398:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788483220.918411:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788483220.918438:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788483220.918454:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788483220.918466:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788483220.918478:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788483220.918488:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788483220.918510:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788483220.918523:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788483220.918611:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483220.918668:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483220.918712:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483220.918729:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754304 00000100:00100000:3.0:1788483220.918737:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754304 00000100:00100000:3.0:1788483220.918787:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788483220.918796:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483220.918900:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754304:12345-0@lo:501:mount.lustre.0 Request processed in 105us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.918912:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788483220.919401:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483220.919438:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483220.919482:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483220.919511:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754432 00000100:00100000:1.0:1788483220.919514:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788483220.919517:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754432 00000100:00100000:0.0:1788483220.919560:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788483220.919567:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483220.919958:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754432:12345-0@lo:503:mount.lustre.0 Request processed in 390us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483220.919966:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788483220.921302:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754432:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788483220.921723:0:19541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788483220.921796:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483220.921852:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.921893:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610000 going to sleep for 11 seconds 00000100:00100000:2.0:1788483220.921961:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754560 00000100:00100000:2.0:1788483220.921969:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754560 00000100:00100000:2.0:1788483220.922014:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788483220.922039:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483220.922158:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754560:12345-0@lo:502:mount.lustre.0 Request processed in 136us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483220.922166:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788483220.922590:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483220.922793:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788483220.922819:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788483220.922832:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788483220.922845:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788483220.922857:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788483220.922869:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788483220.922882:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788483220.922893:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788483220.922905:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788483220.922916:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788483220.923161:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788483220.923183:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788483220.923196:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788483220.923208:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788483220.923221:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788483220.923234:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788483220.923248:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788483220.923259:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788483220.923287:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788483220.923302:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788483220.924183:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788483220.924221:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788483220.924236:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788483220.924250:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788483220.924261:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788483220.924273:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788483220.924286:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788483220.924298:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788483220.924310:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788483220.924794:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788483220.924805:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788483220.924816:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788483220.924827:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788483220.924837:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788483220.924862:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788483220.924876:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788483220.924887:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788483220.924898:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788483220.924909:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788483220.924919:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788483220.926701:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788483220.926734:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788483220.926749:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788483220.926764:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788483220.926779:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788483220.926794:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788483220.926810:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788483220.926825:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788483220.926880:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483220.927198:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.927298:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610000 going to sleep for 11 seconds 00000100:00100000:0.0:1788483220.928529:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754688 00000100:00100000:0.0:1788483220.928545:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754688 00000100:00100000:0.0:1788483220.928597:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788483220.928606:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483220.929592:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754688:12345-0@lo:502:mount.lustre.0 Request processed in 986us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483220.929602:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788483220.933750:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483220.934046:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788483220.934075:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788483220.934131:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483220.934195:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483220.934237:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25f2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483220.935779:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754816 00000100:00100000:1.0:1788483220.935793:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754816 00000100:00100000:1.0:1788483220.935853:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788483220.935866:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483220.936037:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098754816:12345-0@lo:502:mount.lustre.0 Request processed in 174us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483220.936045:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788483220.936209:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098754816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483220.936281:0:19541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788483220.936294:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788483220.938310:0:19555:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788483220.938326:0:19555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a69c76d19b8) 00000020:00000080:2.0:1788483220.938350:0:19555:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788483220.938447:0:19555:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c331b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788483220.938451:0:19555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c331b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788483220.938458:0:19555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c331b000 3 00010000:00080000:2.0:1788483220.938486:0:19555:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69c5056000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483220.942320:0:19555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788483220.942522:0:19555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788483220.942565:0:19555:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788483220.942578:0:19555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1d7ea3d89ea1ba53 00000100:00080000:2.0:1788483220.942589:0:19555:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483220.942594:0:19555:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a69c5056000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483220.942627:0:19555:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd936300 x1875360098754944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483220.942655:0:19555:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788483220.942713:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483220.942717:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788483220.942719:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483220.942723:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1788483220.942725:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788483220.942729:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69efd93800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483220.942741:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd936680 x1875360098755328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483220.942773:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483220.942776:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788483220.942777:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483220.942780:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1788483220.942782:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788483220.942785:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69c2b8d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483220.942795:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c35fb480 x1875360098755840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483220.942848:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098755072:0@lo:400:kworker.0 00000100:00100000:2.0:1788483220.942909:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483220.942938:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098755712:0@lo:400:kworker.0 00000100:00100000:2.0:1788483220.942960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483220.942980:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788483220.942986:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098755200:0@lo:400:kworker.0 00000100:00100000:2.0:1788483220.943034:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483220.943049:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098755968:0@lo:400:kworker.0 00000100:00100000:2.0:1788483220.943071:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943503:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098754944:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483220.943545:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943575:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098755328:0@lo:8:kworker.0 00000100:00100000:3.0:1788483220.943595:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943613:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098755840:0@lo:8:kworker.0 00000100:00100000:3.0:1788483220.943629:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943653:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098755456:0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.943686:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943704:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098756096:0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.943721:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943735:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788483220.943740:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098755584:0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.943757:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943773:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098756224:0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.943792:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.943816:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755072 00000100:00100000:3.0:1788483220.943822:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755072 00000100:00100000:3.0:1788483220.943857:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755584 00000100:00100000:3.0:1788483220.943860:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755584 00000100:00100000:3.0:1788483220.943873:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483220.943881:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098755072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.943929:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098755072:12345-0@lo:400:kworker.0 Request processed in 48us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.943937:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483220.943950:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788483220.943956:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098755584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.943996:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098755584:12345-0@lo:400:kworker.0 Request processed in 40us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944002:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788483220.944019:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755712 00000100:00100000:3.0:1788483220.944038:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755712 00000100:00100000:3.0:1788483220.944066:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755200 00000100:00100000:3.0:1788483220.944069:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755200 00000100:00100000:3.0:1788483220.944079:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755328 00000100:00100000:3.0:1788483220.944082:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755328 00000100:00100000:3.0:1788483220.944088:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755840 00000100:00100000:3.0:1788483220.944090:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755840 00000100:00100000:3.0:1788483220.944123:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483220.944130:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098755712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.944159:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098755712:12345-0@lo:400:kworker.0 Request processed in 30us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944164:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483220.944174:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483220.944180:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098755200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.944204:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098755200:12345-0@lo:400:kworker.0 Request processed in 25us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944209:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483220.944220:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483220.944223:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098755328:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788483220.944265:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098755328:12345-0@lo:8:kworker.0 Request processed in 39us (668us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788483220.944271:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483220.944281:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788483220.944286:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098755840:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788483220.944323:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098755840:12345-0@lo:8:kworker.0 Request processed in 36us (692us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788483220.944329:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788483220.944351:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755968 00000100:00100000:3.0:1788483220.944355:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755968 00000100:00100000:3.0:1788483220.944372:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098754944 00000100:00100000:3.0:1788483220.944374:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098754944 00000100:00100000:3.0:1788483220.944380:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098755456 00000100:00100000:3.0:1788483220.944382:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098755456 00000100:00100000:3.0:1788483220.944390:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756096 00000100:00100000:3.0:1788483220.944392:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756096 00000100:00100000:3.0:1788483220.944402:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756224 00000100:00100000:3.0:1788483220.944405:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756224 00000100:00100000:3.0:1788483220.944420:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788483220.944425:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098755968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.944454:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098755968:12345-0@lo:400:kworker.0 Request processed in 29us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944459:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788483220.944470:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483220.944476:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098755456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.944501:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098755456:12345-0@lo:400:kworker.0 Request processed in 26us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944506:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483220.944517:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788483220.944523:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098756096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.944548:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098756096:12345-0@lo:400:kworker.0 Request processed in 25us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944552:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788483220.944571:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788483220.944577:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098756224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.944604:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098756224:12345-0@lo:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944609:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788483220.944621:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483220.944625:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098754944:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788483220.944652:0:17222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1788483220.944682:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1d7ea3d89ea1ba5a 00000004:00100000:3.0:1788483220.944696:0:17222:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788483220.944724:0:17222:0:(import.c:65:import_set_state_nolock()) ffff9a69e8fa8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483220.944756:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875360098754944:12345-0@lo:38:llog_process_th.0 Request processed in 129us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483220.944762:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483220.944811:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098755584:0@lo:400:kworker.0 00010000:00080000:3.0:1788483220.944824:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3f67480 x1875360098756224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483220.944834:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098756224:0@lo:400:kworker.0 00010000:00080000:3.0:1788483220.944843:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c35fbb80 x1875360098755456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483220.944849:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098755456:0@lo:400:kworker.0 00010000:00080000:3.0:1788483220.944857:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c35f9500 x1875360098756096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483220.944863:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098756096:0@lo:400:kworker.0 00000100:00080000:3.0:1788483220.944898:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483220.944902:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483220.944905:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788483220.944922:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd936300 x1875360098754944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483220.944930:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483220.944936:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788483220.944943:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788483220.944947:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788483220.944949:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788483220.944955:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098754944:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483220.944964:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483220.944968:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483220.944971:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788483220.944974:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098755328:0@lo:8:kworker.0 00000100:00100000:3.0:1788483220.944982:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483220.944985:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483220.944988:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788483220.944991:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098755840:0@lo:8:kworker.0 00000100:00100000:3.0:1788483220.945020:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098755200:0@lo:400:kworker.0 00010000:00080000:3.0:1788483220.945047:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c35fb100 x1875360098755968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483220.945056:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098755968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.945067:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098755072:0@lo:400:kworker.0 00000100:00100000:3.0:1788483220.945085:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098755712:0@lo:400:kworker.0 00000020:01000004:1.0:1788483220.954476:0:19555:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788483220.954497:0:19555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a69e009cd28) 00000020:00000080:1.0:1788483220.954522:0:19555:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788483220.954954:0:19555:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c331b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788483220.954959:0:19555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c331b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788483220.954962:0:19555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c331b000 3 00010000:00080000:1.0:1788483220.955005:0:19555:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c1fc5800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788483220.959296:0:19555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788483220.959474:0:19555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788483220.959519:0:19555:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788483220.959533:0:19555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1d7ea3d89ea1ba68 00000100:00080000:1.0:1788483220.959543:0:19555:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788483220.959555:0:19555:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a68c1fc5800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483220.959591:0:19555:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69fd8f6d80 x1875360098756352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483220.967770:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098756352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483220.967845:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788483220.967923:0:19555:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788483220.984155:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756352 00000100:00100000:2.0:1788483220.984167:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756352 00000100:00100000:2.0:1788483220.984216:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483220.984224:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098756352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788483220.984254:0:17222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1788483220.984288:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1d7ea3d89ea1ba6f 00000004:00100000:2.0:1788483220.984304:0:17222:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788483220.984335:0:17222:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c7000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788483220.988399:0:19555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788483220.990266:0:19541:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788483220.990306:0:19541:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788483220.990324:0:19541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483220.990336:0:19541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788483220.990389:0:19541:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788483220.990392:0:19541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788483220.990393:0:19541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483220.990395:0:19541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483220.990396:0:19541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483220.990398:0:19541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483220.990399:0:19541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788483220.990401:0:19541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483220.990402:0:19541:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788483220.990406:0:19541:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788483220.990408:0:19541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483220.990410:0:19541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788483220.990410:0:19541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483220.990412:0:19541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483220.990413:0:19541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483220.990414:0:19541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483220.990415:0:19541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788483220.990416:0:19541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483220.990417:0:19541:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788483220.990442:0:19541:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788483220.990460:0:19541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098756480:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483220.990525:0:19541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483220.990571:0:19541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2610000 going to sleep for 11 seconds 00000100:00100000:2.0:1788483220.995949:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875360098756352:12345-0@lo:38:llog_process_th.0 Request processed in 11716us (28094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483220.995964:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483220.996227:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756480 00000100:00100000:2.0:1788483220.996857:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756480 00000100:00100000:2.0:1788483220.996916:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788483220.996925:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098756480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483220.996954:0:17217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788483220.996981:0:17217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788483220.997482:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69fd8f6d80 x1875360098756352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483220.997495:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788483220.997503:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788483220.997511:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788483220.997516:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788483220.997519:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c1fc5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788483220.997525:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098756352:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788483221.004983:0:17217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788483221.005008:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788483221.005448:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:19541:x1875360098756480:12345-0@lo:253:mount.lustre.0 Request processed in 8519us (14918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483221.005460:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 20000000:01000000:0.0:1788483221.005833:0:17238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788483221.005839:0:17238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788483221.005857:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483221.005871:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483221.005879:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483221.005888:0:17238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483221.005923:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483221.005958:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 23 pid: 17217 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483221.005970:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098756608:0@lo:104: 00000100:00100000:3.0:1788483221.006246:0:19541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4be19e4a-e21c-409c-93a6-e1423c5e2099:19541:1875360098756480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788483221.006258:0:19541:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788483221.006261:0:19541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788483221.006263:0:19541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788483221.006264:0:19541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483221.006266:0:19541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483221.006267:0:19541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483221.006268:0:19541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483221.006270:0:19541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788483221.006271:0:19541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483221.006273:0:19541:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788483221.006286:0:19541:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788483221.007191:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483221.007303:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483221.007335:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 23 pid: 17216 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483221.007349:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098756736:0@lo:104: 00000100:00100000:0.0:1788483221.007389:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483221.014288:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2799240 going to sleep for 11 seconds 00000100:00100000:1.0:1788483221.014403:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756608 00000100:00100000:1.0:1788483221.014413:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756608 00000100:00100000:2.0:1788483221.018293:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756736 00000100:00100000:2.0:1788483221.018305:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756736 00000100:00100000:2.0:1788483221.018344:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483221.018353:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:17238:x1875360098756608:12345-0@lo:104: 00010000:00010000:2.0:1788483221.018371:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018459:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788483221.018465:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:17238:x1875360098756608:12345-0@lo:104: Request processed in 113us (12372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483221.018473:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483221.018490:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788483221.018496:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098756736:12345-0@lo:104: 00010000:00010000:2.0:1788483221.018516:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018550:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788483221.018555:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:17238:x1875360098756736:12345-0@lo:104: Request processed in 60us (11167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483221.018562:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788483221.018583:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483221.018588:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018595:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8a00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483221.018599:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018608:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483221.018631:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483221.018637:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788483221.018671:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018677:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483221.018695:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018702:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1b926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b92d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018720:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483221.018723:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018729:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9000 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483221.018731:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018737:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483221.018743:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483221.018747:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788483221.018760:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018765:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483221.018771:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018777:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9000/0x1d7ea3d89ea1b918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b91f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.018788:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483221.018789:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483221.018791:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483221.018810:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098756992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483221.018851:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483221.018878:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483221.018884:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098756864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483221.018904:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483221.018931:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756992 00000100:00100000:2.0:1788483221.018936:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756992 00010000:00010000:2.0:1788483221.018952:0:17208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 24 pid: 17216 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483221.018970:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098756864 00000100:00100000:2.0:1788483221.018973:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098756864 00010000:00010000:2.0:1788483221.018984:0:17208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 25 pid: 17217 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483221.019010:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483221.019017:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+25:3620:x1875360098756992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483221.019038:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483221.019044:0:17208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 25 pid: 17216 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019054:0:17208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 25 pid: 17216 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019070:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483221.019119:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+25:3620:x1875360098756992:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483221.019126:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483221.019140:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788483221.019146:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3620:x1875360098756864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483221.019161:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483221.019165:0:17208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 24 pid: 17217 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019175:0:17208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 24 pid: 17217 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019186:0:17208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019194:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788483221.019208:0:17208:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015572219s 00010000:00010000:2.0:1788483221.019213:0:17208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019220:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019228:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019235:0:17208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019241:0:17208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483221.019245:0:17208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019253:0:17208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019268:0:17208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019278:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483221.019301:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3620:x1875360098756864:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483221.019307:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788483221.019343:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098756864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483221.019352:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098756992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483221.019396:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1b92d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b926 expref: 23 pid: 17217 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483221.019406:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098756608:0@lo:104: 00010000:00010000:2.0:1788483221.019416:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1b91f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b918 expref: 22 pid: 17216 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483221.019424:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17238:1875360098756736:0@lo:104: 00010000:00010000:2.0:1788483221.019437:0:17238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019446:0:17238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019452:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.019459:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba76 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483221.021236:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788483221.026552:0:19541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788483221.030938:0:19541:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788483221.030948:0:19541:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788483221.030982:0:19541:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788483221.031046:0:19541:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788483221.031083:0:19541:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788483221.031133:0:19541:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788483221.031867:0:19541:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483221.032125:0:19541:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788483221.822432:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788483222.068037:0:19608:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483222.068286:0:19608:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788483222.526774:0:17219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788483222.526781:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c3dba000 from 10 10000000:01000000:3.0:1788483222.526786:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788483222.526829:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483222.526840:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483222.526851:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483222.526890:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483222.526952:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483222.526998:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e00c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788483222.527952:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098757120 00000100:00100000:0.0:1788483222.527962:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098757120 00000100:00100000:0.0:1788483222.528030:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788483222.528040:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:17219:x1875360098757120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483222.528054:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483222.528069:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6a021c7600/0x1d7ea3d89ea1ba84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1ba7d expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528118:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6a021c7600/0x1d7ea3d89ea1ba84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba7d expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528130:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6a021c7600/0x1d7ea3d89ea1ba84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba7d expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528139:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c7600, rc 0) 00000100:00100000:0.0:1788483222.528188:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098757120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483222.528195:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788483222.528211:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483222.528226:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483222.528236:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483222.528357:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788483222.528393:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483222.528428:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e00c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788483222.528518:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098757248 00000100:00100000:0.0:1788483222.528523:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098757248 00000100:00100000:0.0:1788483222.528553:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788483222.528568:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098757248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483222.528582:0:17217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483222.528598:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483222.528600:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788483222.528692:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098757248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483222.528699:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788483222.528730:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788483222.528787:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483222.528794:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528802:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483222.528811:0:17219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788483222.528813:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69ece13000 from 10 10000000:01000000:0.0:1788483222.528816:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788483222.528833:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528840:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528848:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483222.528859:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483222.528892:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483222.528905:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1d49000 going to sleep for 11 seconds 00000100:00100000:0.0:1788483222.528917:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098757376 00000100:00100000:0.0:1788483222.528921:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098757376 00000100:00100000:0.0:1788483222.528940:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788483222.528946:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098757376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483222.528953:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483222.528961:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6a021c6200/0x1d7ea3d89ea1ba92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1ba8b expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528974:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6a021c6200/0x1d7ea3d89ea1ba92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba8b expref: 24 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.528994:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6a021c6200/0x1d7ea3d89ea1ba92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba8b expref: 24 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.529002:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6200, rc 0) 00000100:00100000:0.0:1788483222.529048:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098757376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483222.529054:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788483222.529254:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483222.529267:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483222.529274:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483222.529314:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788483222.529343:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483222.529365:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e00c4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788483222.529540:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098757504 00000100:00100000:0.0:1788483222.529545:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098757504 00000100:00100000:0.0:1788483222.529580:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788483222.529586:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098757504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483222.529596:0:17215:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483222.529609:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483222.529612:0:17215:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788483222.529693:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098757504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483222.529705:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788483222.529737:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098757504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788483222.529779:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483222.529784:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483222.529792:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483222.776468:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098757632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483222.776534:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483222.776777:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098757632 00000100:00100000:2.0:1788483222.776786:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098757632 00000100:00100000:2.0:1788483222.776842:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483222.776851:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098757632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483222.776876:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483222.776920:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098757632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483222.776927:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483222.776968:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098757632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788483222.777037:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483222.777248:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098757760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483222.777282:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483222.777350:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098757760 00000100:00100000:3.0:1788483222.777367:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098757760 00000100:00100000:3.0:1788483222.777409:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483222.777416:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098757760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483222.777427:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483222.777458:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098757760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483222.777465:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788483222.777542:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098757760:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788483222.777594:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788483222.844599:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483223.801737:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483223.801757:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098757888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483223.801821:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483223.801866:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098757888 00000100:00100000:3.0:1788483223.801873:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098757888 00000100:00100000:3.0:1788483223.801917:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483223.801926:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098757888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788483223.801960:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483223.802025:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098757888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483223.802032:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483223.802077:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098757888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483223.802475:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483223.802487:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098758016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483223.802520:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483223.802592:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758016 00000100:00100000:0.0:1788483223.802598:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758016 00000100:00100000:0.0:1788483223.802637:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788483223.802644:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098758016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483223.802664:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483223.802699:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098758016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483223.802706:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788483223.802770:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098758016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483223.869506:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483224.888437:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483225.336964:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788483225.914936:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483226.370823:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483226.370832:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483226.370836:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483226.370852:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69efd93800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483226.370891:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c6231c00 x1875360098758528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483226.370933:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483226.370936:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483226.370938:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483226.370943:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69c2b8d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483226.370955:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c452d500 x1875360098759040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483226.371040:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098758272:0@lo:400:kworker.0 00000100:00100000:0.0:1788483226.371146:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.371256:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098758656:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.371334:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483226.371348:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098758144:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.371397:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758272 00000100:00100000:3.0:1788483226.371406:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758272 00000100:00100000:2.0:1788483226.371407:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483226.371449:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098758528:0@lo:8:kworker.0 00000100:00100000:3.0:1788483226.371471:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788483226.371490:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098758272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483226.371504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.371563:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098758272:12345-0@lo:400:kworker.0 Request processed in 82us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.371583:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788483226.371613:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758656 00000100:00100000:3.0:1788483226.371617:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758656 00000100:00100000:3.0:1788483226.371657:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788483226.371663:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098758656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.371695:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098758656:12345-0@lo:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.371700:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788483226.371721:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758528 00000100:00100000:3.0:1788483226.371725:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758528 00000100:00100000:3.0:1788483226.371742:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483226.371746:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098758528:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788483226.371772:0:18731:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:3.0:1788483226.371800:0:18731:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1ba99 00002000:00100000:3.0:1788483226.371814:0:18731:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a68c24d5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788483226.371819:0:18731:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788483226.371822:0:18731:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788483226.371975:0:18731:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788483226.372013:0:18731:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483226.372061:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098758528:12345-0@lo:8:kworker.0 Request processed in 313us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.372068:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483226.374479:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098758272:0@lo:400:kworker.0 00010000:00080000:3.0:1788483226.374519:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c6230e00 x1875360098758656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483226.374538:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098758656:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.374569:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098759296:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.374627:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.374670:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788483226.374678:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098758400:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.374703:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.374722:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098759168:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.374743:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.374762:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098759680:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.374781:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.374835:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098758784:0@lo:400:kworker.0 00000100:00100000:2.0:1788483226.374861:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759296 00000100:00100000:3.0:1788483226.374870:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483226.374875:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759296 00000100:00100000:3.0:1788483226.374898:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098759424:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.374926:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483226.374960:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759168 00000100:00100000:2.0:1788483226.374966:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759168 00000100:00100000:3.0:1788483226.374991:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759680 00000100:00100000:2.0:1788483226.375003:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759424 00000100:00100000:3.0:1788483226.375009:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759680 00000100:00100000:2.0:1788483226.375010:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759424 00000100:00100000:2.0:1788483226.375046:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788483226.375081:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098758912:0@lo:400:kworker.0 00000100:00100000:0.0:1788483226.375163:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.375422:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788483226.375435:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098759168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.375506:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098759168:12345-0@lo:400:kworker.0 Request processed in 74us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.375513:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788483226.375530:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788483226.375537:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098759424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.375569:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098759424:12345-0@lo:400:kworker.0 Request processed in 33us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.375587:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788483226.375604:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098759552:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.375605:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483226.375619:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098759680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.375647:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098759680:12345-0@lo:400:kworker.0 Request processed in 30us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.375652:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483226.375672:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758400 00000100:00100000:3.0:1788483226.375676:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758400 00000100:00100000:3.0:1788483226.375702:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758912 00000100:00100000:3.0:1788483226.375705:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758912 00000100:00100000:3.0:1788483226.375723:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483226.375729:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098758400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.375758:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098758400:12345-0@lo:400:kworker.0 Request processed in 30us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.375763:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483226.375774:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483226.375780:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098758912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.375805:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098758912:12345-0@lo:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.375810:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483226.375825:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758784 00000100:00100000:3.0:1788483226.375828:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758784 00000100:00100000:3.0:1788483226.375848:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788483226.375853:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098758784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.375879:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098758784:12345-0@lo:400:kworker.0 Request processed in 25us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483226.375893:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788483226.375929:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c5419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098758784:0@lo:400:kworker.0 00010000:00080000:3.0:1788483226.375941:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c452d180 x1875360098759424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483226.375950:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098759424:0@lo:400:kworker.0 00000100:00100000:3.0:1788483226.376025:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098758400:0@lo:400:kworker.0 00010000:00080000:3.0:1788483226.376035:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c452f800 x1875360098759168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483226.376044:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098759168:0@lo:400:kworker.0 00010000:00080000:3.0:1788483226.376053:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c452fb80 x1875360098759680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483226.376060:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098759680:0@lo:400:kworker.0 00000100:00100000:2.0:1788483226.376585:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098759296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483226.377161:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483226.377317:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098759296:12345-0@lo:400:kworker.0 Request processed in 2260us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483226.377334:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483226.377368:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759552 00000100:00100000:2.0:1788483226.377376:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759552 00000100:00100000:2.0:1788483226.377413:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788483226.377420:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098759552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483226.377449:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098759552:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483226.377454:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788483226.377514:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c6231c00 x1875360098758528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788483226.377537:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788483226.377545:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788483226.377551:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788483226.377556:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788483226.377577:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788483226.377584:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098758528:0@lo:8:kworker.0 00000100:00100000:2.0:1788483226.377595:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098759040:0@lo:8:kworker.0 00010000:00080000:0.0:1788483226.377745:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c452ed80 x1875360098759552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483226.377756:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098759552:0@lo:400:kworker.0 00000100:00100000:0.0:1788483226.377791:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098758912:0@lo:400:kworker.0 00000100:00100000:0.0:1788483226.377825:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098758144 00000100:00100000:0.0:1788483226.377829:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098758144 00000100:00100000:0.0:1788483226.377864:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788483226.377872:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3621:x1875360098758144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483226.377930:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3621:x1875360098758144:12345-0@lo:400:kworker.0 Request processed in 59us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483226.377936:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00080000:0.0:1788483226.378004:0:17248:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788483226.378127:0:17248:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518641030542ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788483226.378134:0:17248:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788483226.378437:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098758144:0@lo:400:kworker.0 00000100:00100000:2.0:1788483226.378714:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788483226.378764:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483226.378770:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483226.378773:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483226.378793:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759040 00000100:00100000:2.0:1788483226.378798:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759040 00000100:00100000:2.0:1788483226.378826:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483226.378834:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3618:x1875360098759040:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788483226.378865:0:19165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788483226.378911:0:19165:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1baa0 00002000:00100000:2.0:1788483226.378928:0:19165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a69f4518800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788483226.378932:0:19165:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788483226.378935:0:19165:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788483226.378987:0:19165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788483226.379026:0:19165:0:(import.c:65:import_set_state_nolock()) ffff9a69f4519800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483226.379082:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098759040:12345-0@lo:8:kworker.0 Request processed in 249us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483226.379090:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788483226.379174:0:17249:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788483226.379204:0:17249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17249:1875360098759936:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788483226.379231:0:17249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483226.379247:0:17249:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d01b30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483226.379260:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759936 00000100:00100000:2.0:1788483226.379263:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759936 00000100:00100000:2.0:1788483226.379296:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483226.379301:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17249:x1875360098759936:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788483226.379546:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483226.379556:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098759808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483226.379584:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483226.379609:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098759808 00000100:00100000:2.0:1788483226.381327:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098759808 00000100:00100000:2.0:1788483226.381409:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788483226.381421:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098759808:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788483226.381566:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c452d500 x1875360098759040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483226.381588:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788483226.381598:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788483226.381605:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788483226.381609:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788483226.381631:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788483226.381639:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098759040:0@lo:8:kworker.0 00002000:00000024:2.0:1788483226.381811:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788483226.381907:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875360098759808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 489us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483226.381922:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788483226.381955:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788483226.382759:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3f66d80 x1875360098759808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483226.382792:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098759808:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788483226.383274:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c452df80 x1875360098759296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483226.383287:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098759296:0@lo:400:kworker.0 00000004:00080000:1.0:1788483226.384769:0:17967:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788483226.384803:0:17967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17967:1875360098760192:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788483226.384886:0:17967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483226.384920:0:17967:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e9c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788483226.384943:0:17966:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788483226.385066:0:17966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 518647969306ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788483226.385074:0:17966:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788483226.385739:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098760064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483226.385792:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483226.386004:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760064 00000100:00100000:1.0:1788483226.386013:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760064 00000100:00100000:1.0:1788483226.386146:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788483226.386158:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875360098760064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483226.386409:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788483226.386471:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875360098760064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 315us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483226.386479:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788483226.386541:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f5f80 x1875360098760064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483226.386564:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098760064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483226.387232:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760192 00000100:00100000:2.0:1788483226.387242:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760192 00000100:00100000:2.0:1788483226.387284:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788483226.387292:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17967:x1875360098760192:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1788483226.387915:0:18729:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788483226.387925:0:18729:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788483226.387932:0:18729:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00080000:3.0:1788483226.389760:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788483226.405892:0:19165:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788483226.405925:0:19165:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788483226.406171:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17967:x1875360098760192:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18862us (21267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483226.406186:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788483226.406800:0:17967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f6d80 x1875360098760192/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788483242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483226.406821:0:17967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17967:1875360098760192:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788483226.406838:0:17967:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788483226.406893:0:17967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17967:1875360098760320:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788483226.406947:0:17967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483226.406980:0:17967:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2e3f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483226.407028:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760320 00000100:00100000:0.0:1788483226.407037:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760320 00000100:00100000:0.0:1788483226.407139:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788483226.407143:0:17202:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788483226.407155:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17967:x1875360098760320:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788483226.407211:0:18730:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788483226.407257:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17967:x1875360098760320:12345-0@lo:5:osp-pre-1-1.0 Request processed in 109us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483226.407264:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788483226.407295:0:17967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c452c700 x1875360098760320/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788483242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483226.407305:0:17967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17967:1875360098760320:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788483226.407315:0:17967:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788483226.407362:0:17967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17967:1875360098760448:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788483226.407387:0:17967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483226.407406:0:17967:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2e3f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483226.407422:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760448 00000100:00100000:0.0:1788483226.407427:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760448 00000100:00100000:0.0:1788483226.407452:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483226.407459:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17967:x1875360098760448:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788483226.407489:0:18731:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788483226.410608:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.410757:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.410780:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.410787:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.410795:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.410820:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.410833:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.410842:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.410868:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483226.410903:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.410918:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.410933:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.410939:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.410951:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.410991:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.411010:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.411060:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.411063:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.411065:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.413658:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.413672:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.413689:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.413694:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.413700:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.413713:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.413723:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.413730:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.413866:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483226.414437:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.414445:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.414455:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.414460:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.414470:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.414509:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.414518:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050601b14/0x1d7ea3d89ea1baae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.414552:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.414554:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.414556:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788483226.414722:0:17955:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1788483226.414942:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.414948:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.414967:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.414971:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.414975:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.414984:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.414991:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.415010:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.415031:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483226.415308:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.415314:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.415323:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.415327:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.415336:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.415351:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.415359:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c878743/0x1d7ea3d89ea1bab5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.415376:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.415378:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.415380:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.416323:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.416333:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.416347:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.416351:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.416356:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.416367:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.416390:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.416398:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.416421:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483226.416719:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.416725:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.416744:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.416749:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.416757:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.416772:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.416780:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d40b5ead/0x1d7ea3d89ea1babc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.416796:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.416798:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.416799:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.419933:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.419947:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.419963:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.419967:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.419974:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.419987:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.420008:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.420015:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.420058:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483226.420612:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483226.420637:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.420652:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483226.420659:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.420671:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.420697:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.420705:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089545065/0x1d7ea3d89ea1bac3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.420736:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.420738:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.420740:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.424867:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.424882:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.424900:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.424904:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.424911:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.424925:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.424934:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.424941:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.424961:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483226.424972:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.424978:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.424986:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.425013:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.425023:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.425038:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.425046:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1baca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.425067:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.425068:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.426722:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.428827:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.428839:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.428856:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.428860:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.428867:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.428882:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.428894:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.428913:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.428935:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483226.429180:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.429185:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.429193:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.429197:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.429205:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.429221:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.429227:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bad1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.429240:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.429242:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.429243:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.430784:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.430815:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.430836:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.430841:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.430849:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.430864:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.430875:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.430883:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.430901:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483226.431176:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.431189:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.431202:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8aa00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.431207:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.431217:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.431249:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.431256:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeef44b4/0x1d7ea3d89ea1bad8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.431280:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.431282:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.431284:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.432561:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.432576:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.432594:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.432599:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.432607:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.432635:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.432657:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.432665:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.432690:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483226.432819:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483226.432832:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.432844:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ba00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483226.432849:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.432881:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.432899:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.432907:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd781aeb/0x1d7ea3d89ea1badf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.432929:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.432931:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.432932:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.437868:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.437880:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.437897:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.437902:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.437908:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.437922:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.437932:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.437947:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.438084:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483226.440785:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.440798:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.440814:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.440819:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.440825:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.440839:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.440848:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.440856:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444240:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483226.444254:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444267:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.444272:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444281:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444300:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444308:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bae6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444335:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.444356:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444363:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.444366:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444374:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444384:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.444391:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.444393:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.444395:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.445673:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788483226.445683:0:18729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1baed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483226.448303:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483226.448317:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.448351:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788483226.448357:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483226.448364:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.448381:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.448392:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.448400:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.452352:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.452366:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.452380:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.452385:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.452395:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.452416:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.455797:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.455805:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.455809:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.457819:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788483226.457840:0:18729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd07c2c7/0x1d7ea3d89ea1baf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459131:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.459304:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.459315:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.459333:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.459338:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.459345:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.459361:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.459371:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.459379:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.459403:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483226.459654:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.459662:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459671:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.459677:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459686:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459705:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459712:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bafb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459732:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.459734:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.459736:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.459888:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.459895:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459903:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.459913:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.459917:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459926:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459933:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459940:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.459956:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483226.460759:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.460768:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.460780:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.460784:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.460789:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.460801:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.460811:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.460817:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.460833:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.460836:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.460867:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.460875:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.460884:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483226.460888:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.460899:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.460913:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.460923:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52e27b4/0x1d7ea3d89ea1bb02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.460944:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.460946:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.460949:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.461550:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.461559:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.461561:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.461593:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.461603:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483226.461607:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.461625:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.461644:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.461652:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec8a1b5/0x1d7ea3d89ea1bb09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.461672:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.461679:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.461680:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.464619:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.464632:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.464663:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.464668:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.464676:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.464691:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.464701:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.464708:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.464731:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483226.465011:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.465018:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.465026:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.465030:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.465039:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.465055:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.465063:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1bb10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.465083:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.465085:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.465087:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483226.486460:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483226.486475:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.486492:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788483226.486497:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483226.488304:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.488331:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.488342:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.488350:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.488408:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483226.490523:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483226.490544:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.490563:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ac00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483226.490569:0:19802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.490599:0:19802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.490811:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.490820:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6d1e1c/0x1d7ea3d89ea1bb17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.490868:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.490870:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.490872:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.493869:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.493884:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.493902:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.493907:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.493913:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.493927:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.493937:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.493945:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.494006:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483226.494954:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.494965:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.494977:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.494982:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.495020:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.495039:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.495047:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1bb1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.495068:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.495070:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.495072:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788483226.497217:0:19542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788483226.497333:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788483226.497340:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788483226.497528:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17967:x1875360098760448:12345-0@lo:5:osp-pre-1-1.0 Request processed in 90063us (90134us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788483226.497539:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788483226.497600:0:17967:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788483226.497608:0:17967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17967:1875360098760448:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788483226.497626:0:17967:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788483226.497678:0:17967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17967:1875360098760576:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788483226.497713:0:17967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483226.497737:0:17967:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483226.497782:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760576 00000100:00100000:1.0:1788483226.497790:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760576 00000100:00100000:1.0:1788483226.497831:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483226.497840:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17967:x1875360098760576:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788483226.499054:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1788483226.499064:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17967:x1875360098760576:12345-0@lo:900:osp-pre-1-1.0 Request processed in 1219us (1343us total) trans 0 rc 0/0 00010000:00010000:0.0:1788483226.499069:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483226.499075:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788483226.499091:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.499122:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.499130:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.499160:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.499172:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.499180:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.499202:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788483226.499301:0:17967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f5f80 x1875360098760576/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788483242 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483226.499315:0:17967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17967:1875360098760576:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788483226.499350:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.499356:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.499365:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.499369:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.499378:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.499394:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.499401:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1bb25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.499435:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.499438:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.499439:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.500545:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.500556:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.500568:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.500580:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.500585:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.500598:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.500606:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.500613:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.500635:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483226.501387:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.501395:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.501609:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.501613:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.501618:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.501631:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.501640:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.501657:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.501677:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788483226.503758:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483226.503778:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.503796:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483226.503804:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.503819:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.503830:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483226.503844:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.503850:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.503861:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1bb2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.503891:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483226.503899:0:19802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.503912:0:19802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.503913:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.503917:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.503921:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.503942:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.503952:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ff3d15b/0x1d7ea3d89ea1bb33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483226.503977:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.503984:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483226.503987:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.504351:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.504362:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.504375:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.504379:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.504384:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.504405:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.504414:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.504420:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.504445:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483226.504739:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.504749:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.504761:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.504765:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.504775:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.504793:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.504801:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3baf4b/0x1d7ea3d89ea1bb3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.504822:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.504824:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.504826:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.509122:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.509139:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.509175:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.509180:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.509186:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.509199:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.509209:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.509216:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.509240:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483226.509382:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483226.509397:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.509411:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483226.509418:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.509456:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.509481:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.509489:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035560d6a/0x1d7ea3d89ea1bb41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.509520:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.509522:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.509524:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.510313:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.510322:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.510332:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.510336:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.510340:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.510350:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.510371:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.510378:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.510510:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483226.511915:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.511928:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.511941:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.511946:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.511951:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.512153:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.512166:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.512174:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513129:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483226.513146:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513169:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.513175:0:19802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513557:0:19802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513586:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513594:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3bc588c/0x1d7ea3d89ea1bb48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513626:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.513630:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513636:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.513639:0:19802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513645:0:19802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513654:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.513662:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.513664:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.513675:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483226.516132:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788483226.516283:0:18729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091d78cb1/0x1d7ea3d89ea1bb4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.516516:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.518176:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.518189:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.518205:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.518210:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.518216:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.518231:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.518241:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.518248:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.518272:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483226.518363:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483226.518379:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.518393:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483226.518400:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.518412:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.518438:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.518473:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1e53910/0x1d7ea3d89ea1bb56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483226.518507:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.518509:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483226.518512:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483226.519453:0:18729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483226.519464:0:18729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.519485:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788483226.519489:0:18729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483226.519494:0:18729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.519519:0:18729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.519528:0:18729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.519535:0:18729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483226.519557:0:18729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483226.519597:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483226.519610:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788483226.519613:0:18729:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:2.0:1788483226.519628:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483226.519634:0:19802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.519644:0:19802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.519663:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.519671:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf535fe/0x1d7ea3d89ea1bb5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483226.519715:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483226.519717:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17249:x1875360098759936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 140409us (140478us total) trans 0 rc 0/0 00010000:00010000:2.0:1788483226.519719:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483226.519723:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483226.519734:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788483226.519823:0:17249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17249:1875360098759936:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788483226.519846:0:17249:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788483226.519909:0:17249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17249:1875360098760704:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788483226.519975:0:17249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483226.520030:0:17249:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e00c4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788483226.522141:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760704 00000100:00100000:0.0:1788483226.522155:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760704 00000100:00100000:0.0:1788483226.522216:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483226.522227:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17249:x1875360098760704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788483226.522270:0:18730:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1788483226.530828:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17249:x1875360098760704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8596us (10845us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788483226.530857:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788483226.532244:0:17249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17249:1875360098760704:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788483226.532271:0:17249:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1788483226.936892:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483227.914223:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098760832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483227.914288:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483227.914356:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760832 00000100:00100000:1.0:1788483227.914364:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760832 00000100:00100000:1.0:1788483227.914407:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483227.914415:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098760832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788483227.914583:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788483227.915561:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098760832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1142us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483227.915571:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483227.916995:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483227.917019:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098760960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483227.917083:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483227.917182:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098760960 00000100:00100000:0.0:1788483227.917191:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098760960 00000100:00100000:0.0:1788483227.917247:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483227.917260:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098760960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483227.917281:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483227.917319:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098760960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483227.917325:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483227.917375:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098760960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483227.924244:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098760832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788483227.961473:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788483228.842831:0:19899:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788483228.921121:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483228.921142:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098761088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483228.921202:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483228.921608:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761088 00000100:00100000:3.0:1788483228.921619:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761088 00000100:00100000:3.0:1788483228.921691:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788483228.921703:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098761088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788483228.921743:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483228.921811:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098761088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483228.921820:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788483228.921896:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098761088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483228.924511:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483228.924533:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098761216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483228.924592:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483228.924695:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761216 00000100:00100000:0.0:1788483228.924705:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761216 00000100:00100000:0.0:1788483228.924773:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788483228.924786:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098761216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483228.924823:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483228.924886:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098761216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483228.924894:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788483228.925254:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098761216:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483228.984398:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788483229.959068:0:19952:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483229.959878:0:19952:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788483230.009699:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788483230.010336:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483231.041935:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788483231.080639:0:20002:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788483231.081548:0:20002:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788483231.481310:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483231.481332:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098761344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483231.481397:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483231.481463:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761344 00000100:00100000:1.0:1788483231.481469:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761344 00000100:00100000:1.0:1788483231.481518:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483231.481528:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098761344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483231.481555:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788483231.481597:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098761344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.481605:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483231.481649:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098761344:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788483231.483594:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483231.484585:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483231.484606:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098761472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483231.484671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483231.484849:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098761728:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.484882:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483231.484923:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761728 00000100:00100000:0.0:1788483231.484923:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483231.484929:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761728 00000100:00100000:0.0:1788483231.484932:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098761600:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.484981:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483231.484984:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483231.484990:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098761728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.485047:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098761728:12345-0@lo:400:kworker.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.485055:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788483231.485092:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761600 00000100:00100000:3.0:1788483231.485117:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761600 00000100:00100000:3.0:1788483231.485165:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788483231.485173:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098761600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.485208:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098761600:12345-0@lo:400:kworker.0 Request processed in 36us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.485214:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788483231.485238:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098761728:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.485241:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098761600:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.485282:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098761984:0@lo:400:kworker.0 00000100:00100000:0.0:1788483231.485282:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098761856:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.485311:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483231.485311:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483231.485362:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483231.485363:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483231.485369:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098762240:0@lo:400:kworker.0 00000100:00100000:0.0:1788483231.485369:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098762112:0@lo:400:kworker.0 00000100:00100000:0.0:1788483231.485391:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483231.485461:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761856 00000100:00100000:1.0:1788483231.485473:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761856 00000100:00100000:1.0:1788483231.485519:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483231.485525:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098761856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.485559:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098761856:12345-0@lo:400:kworker.0 Request processed in 34us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.485565:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483231.485599:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098762112 00000100:00100000:1.0:1788483231.485603:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098762112 00000100:00100000:1.0:1788483231.485625:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788483231.485631:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098762112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.485667:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098762112:12345-0@lo:400:kworker.0 Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.485672:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788483231.485699:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098762112:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.485700:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483231.485727:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098761856:0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.485914:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098762624:0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.486025:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483231.486055:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483231.486061:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098762496:0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.486084:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483231.486143:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098762368:0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.486167:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483231.486182:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098762880:0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.486215:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483231.486226:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483231.486242:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098762752:0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.486266:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483231.486645:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761984 00000100:00100000:2.0:1788483231.486651:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761984 00000100:00100000:2.0:1788483231.486680:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098762624 00000100:00100000:2.0:1788483231.486684:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098762624 00000100:00100000:2.0:1788483231.486696:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098762496 00000100:00100000:2.0:1788483231.486699:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098762496 00000100:00100000:2.0:1788483231.486708:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098762368 00000100:00100000:2.0:1788483231.486710:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098762368 00000100:00100000:2.0:1788483231.486721:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098762880 00000100:00100000:2.0:1788483231.486723:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098762880 00000100:00100000:2.0:1788483231.486733:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098762752 00000100:00100000:2.0:1788483231.486735:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098762752 00000100:00100000:2.0:1788483231.486749:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788483231.486756:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098761984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483231.486813:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098761984:12345-0@lo:400:kworker.0 Request processed in 58us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483231.486820:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788483231.486835:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788483231.486842:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098762624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483231.486874:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098762624:12345-0@lo:400:kworker.0 Request processed in 33us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483231.486880:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788483231.486892:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788483231.486897:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098762496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483231.486923:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098762496:12345-0@lo:400:kworker.0 Request processed in 26us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483231.486929:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788483231.487828:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788483231.487838:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098762368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483231.487889:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098762368:12345-0@lo:400:kworker.0 Request processed in 54us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483231.487896:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788483231.488254:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098762240 00000100:00100000:0.0:1788483231.488261:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098762240 00000100:00100000:0.0:1788483231.488302:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483231.488310:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098762240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483231.488349:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098762240:12345-0@lo:400:kworker.0 Request processed in 40us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483231.488356:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788483231.488382:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483231.488387:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483231.488390:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788483231.488610:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c6231880 x1875360098761984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483231.488625:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098761984:0@lo:400:kworker.0 00010000:00080000:1.0:1788483231.488658:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c35fbb80 x1875360098762496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483231.488668:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098762496:0@lo:400:kworker.0 00010000:00080000:1.0:1788483231.488679:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c35f8700 x1875360098762624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483231.488687:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098762624:0@lo:400:kworker.0 00010000:00080000:1.0:1788483231.488714:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c35f9500 x1875360098762368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483231.488723:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098762368:0@lo:400:kworker.0 00000100:00100000:1.0:1788483231.488735:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098762240:0@lo:400:kworker.0 00000100:00100000:2.0:1788483231.488830:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788483231.488842:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098762880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483231.488885:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098762880:12345-0@lo:400:kworker.0 Request processed in 47us (2670us total) trans 0 rc 0/0 00010000:00080000:0.0:1788483231.490176:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c6230380 x1875360098762880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483231.490204:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098762880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.490621:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788483231.490637:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098762752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.490712:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098762752:12345-0@lo:400:kworker.0 Request processed in 81us (4444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.490718:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788483231.490753:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c35f8380 x1875360098762752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483231.490762:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098762752:0@lo:400:kworker.0 00000100:00100000:3.0:1788483231.490793:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098761472 00000100:00100000:3.0:1788483231.490800:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098761472 00000100:00100000:3.0:1788483231.490846:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483231.490853:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098761472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483231.490869:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788483231.490908:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098761472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (6237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.490914:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788483231.490932:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483231.494700:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098761472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483231.497143:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483231.539958:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483231.540318:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134208 00000100:00100000:0.0:1788483231.540328:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134208 00000100:00100000:0.0:1788483231.540376:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 117 00000100:00100000:0.0:1788483231.540384:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2389:x1875360087134208:12345-192.168.206.54@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788483231.540411:0:17215:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd@192.168.206.54@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:0.0:1788483231.540440:0:17215:0:(genops.c:1385:class_connect()) connect: client 5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd, cookie 0x1d7ea3d89ea1bb64 00000100:00080000:0.0:1788483231.540575:0:17215:0:(import.c:65:import_set_state_nolock()) ffff9a69f45fd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483231.540644:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+5:2389:x1875360087134208:12345-192.168.206.54@tcp:250:mount.lustre.0 Request processed in 259us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483231.540664:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 117 00000100:00100000:2.0:1788483231.560423:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483231.560520:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134336 00000100:00100000:1.0:1788483231.560530:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134336 00000100:00100000:1.0:1788483231.560584:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 118 00000100:00100000:1.0:1788483231.560594:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+5:14915:x1875360087134336:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483231.560610:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483231.560627:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8ae00/0x1d7ea3d89ea1bb6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e612 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483231.560656:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8ae00/0x1d7ea3d89ea1bb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e612 expref: 6 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483231.560682:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8ae00/0x1d7ea3d89ea1bb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e612 expref: 6 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483231.560691:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8ae00, rc 0) 00000100:00100000:1.0:1788483231.560746:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+6:14915:x1875360087134336:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.560754:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 118 00000100:00100000:1.0:1788483231.566931:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.567032:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134464 00000100:00100000:3.0:1788483231.567041:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134464 00000100:00100000:3.0:1788483231.567146:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 119 00000100:00100000:3.0:1788483231.567156:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+6:14915:x1875360087134464:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788483231.567322:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+6:14915:x1875360087134464:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 168us (400us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788483231.567330:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 119 00000100:00100000:3.0:1788483231.575014:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483231.575128:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134592 00000100:00100000:0.0:1788483231.575137:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134592 00000100:00100000:0.0:1788483231.575206:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 120 00000100:00100000:0.0:1788483231.575216:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+6:14915:x1875360087134592:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788483231.575231:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483231.575246:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1bb72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e619 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483231.575273:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1bb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e619 expref: 7 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483231.575283:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1bb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e619 expref: 7 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483231.575292:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8000, rc 0) 00000100:00100000:0.0:1788483231.575350:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+7:14915:x1875360087134592:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 135us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483231.575357:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 120 00000100:00100000:2.0:1788483231.585036:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483231.585227:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134720 00000100:00100000:1.0:1788483231.585237:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134720 00000100:00100000:1.0:1788483231.585291:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 121 00000100:00100000:1.0:1788483231.585301:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+7:14915:x1875360087134720:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788483231.585451:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14915:x1875360087134720:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 151us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.585459:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 121 00000100:00100000:1.0:1788483231.587000:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.587173:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134848 00000100:00100000:3.0:1788483231.587181:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134848 00000100:00100000:3.0:1788483231.587241:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 122 00000100:00100000:3.0:1788483231.587251:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14915:x1875360087134848:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788483231.587386:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14915:x1875360087134848:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 135us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.587394:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 122 00000100:00100000:3.0:1788483231.597900:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483231.598605:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087134976 00000100:00100000:0.0:1788483231.598617:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087134976 00000100:00100000:0.0:1788483231.598677:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:0.0:1788483231.598688:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14933:x1875360087134976:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483231.598856:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14933:x1875360087134976:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 168us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483231.598864:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:2.0:1788483231.646786:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483231.646879:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087135104 00000100:00100000:1.0:1788483231.646888:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087135104 00000100:00100000:1.0:1788483231.646953:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 124 00000100:00100000:1.0:1788483231.646963:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14933:x1875360087135104:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483231.647660:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14933:x1875360087135104:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 694us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.647670:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 124 00000100:00100000:1.0:1788483231.654670:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.654761:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087135232 00000100:00100000:3.0:1788483231.654771:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087135232 00000100:00100000:3.0:1788483231.654829:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 125 00000100:00100000:3.0:1788483231.654840:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14933:x1875360087135232:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788483231.655013:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14933:x1875360087135232:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 174us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.655021:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 125 00000100:00100000:2.0:1788483231.661270:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483231.661420:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087135360 00000100:00100000:1.0:1788483231.661445:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087135360 00000100:00100000:1.0:1788483231.661501:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 126 00000100:00100000:1.0:1788483231.661511:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d135bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:14915:x1875360087135360:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483231.661527:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483231.661544:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bb79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e64a expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483231.661575:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e64a expref: 9 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483231.661586:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e64a expref: 9 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483231.661596:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a400, rc 0) 00000100:00100000:1.0:1788483231.661656:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d135bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+9:14915:x1875360087135360:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 146us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.661663:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 126 00000100:00100000:2.0:1788483231.680366:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483231.680463:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087135488 00000100:00100000:0.0:1788483231.680473:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087135488 00000100:00100000:0.0:1788483231.680530:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:0.0:1788483231.680541:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+9:14915:x1875360087135488:12345-192.168.206.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788483231.680567:0:17215:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788483231.680591:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788483231.680596:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788483231.680599:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788483231.680603:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788483231.680605:0:17215:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788483231.688765:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+9:14915:x1875360087135488:12345-192.168.206.54@tcp:256:mount.lustre.0 Request processed in 8216us (8398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483231.688780:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:2.0:1788483231.697745:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.699204:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087135616 00000100:00100000:3.0:1788483231.699218:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087135616 00000100:00100000:3.0:1788483231.699286:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 128 00000100:00100000:3.0:1788483231.699297:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+9:14915:x1875360087135616:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788483231.699329:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483231.699349:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e651 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483231.699380:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 10 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483231.699392:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 10 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483231.699402:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c29e2e00, rc 0) 00000100:00100000:3.0:1788483231.699467:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14915:x1875360087135616:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 171us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.699475:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 128 00000100:00100000:2.0:1788483231.704426:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483231.704527:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087135744 00000100:00100000:0.0:1788483231.704537:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087135744 00000100:00100000:0.0:1788483231.704593:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 129 00000100:00100000:0.0:1788483231.704603:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14915:x1875360087135744:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788483231.704746:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14915:x1875360087135744:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 144us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483231.704754:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 129 00000100:00100000:2.0:1788483231.707803:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483231.707892:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087135872 00000100:00100000:1.0:1788483231.707902:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087135872 00000100:00100000:1.0:1788483231.707960:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 130 00000100:00100000:1.0:1788483231.708171:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14915:x1875360087135872:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788483231.708344:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14915:x1875360087135872:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 376us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.708353:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 130 00000100:00100000:2.0:1788483231.714218:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.714414:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136000 00000100:00100000:3.0:1788483231.714424:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136000 00000100:00100000:3.0:1788483231.714479:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:3.0:1788483231.714489:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14939:x1875360087136000:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788483231.714634:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14939:x1875360087136000:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 146us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.714643:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:2.0:1788483231.724854:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483231.726663:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136128 00000100:00100000:1.0:1788483231.726675:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136128 00000100:00100000:1.0:1788483231.726740:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:1.0:1788483231.726751:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14939:x1875360087136128:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483231.726916:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:14939:x1875360087136128:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 167us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.726925:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:2.0:1788483231.745216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483231.745335:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.746462:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136256 00000100:00100000:3.0:1788483231.746480:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136256 00000100:00100000:3.0:1788483231.746535:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136512 00000100:00100000:3.0:1788483231.746538:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136512 00000100:00100000:3.0:1788483231.746560:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:3.0:1788483231.746570:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875360087136256:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788483231.746627:0:17224:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0f66e931-3201-4238-a1e4-162d21e5f09a@192.168.206.54@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788483231.746692:0:17224:0:(genops.c:1385:class_connect()) connect: client 0f66e931-3201-4238-a1e4-162d21e5f09a, cookie 0x1d7ea3d89ea1bb87 00000004:00100000:3.0:1788483231.746725:0:17224:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1788483231.747044:0:17224:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483231.747183:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2389:x1875360087136256:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 613us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.747192:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:3.0:1788483231.747216:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:3.0:1788483231.747221:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875360087136512:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788483231.747239:0:17224:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0f66e931-3201-4238-a1e4-162d21e5f09a@192.168.206.54@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788483231.747273:0:17224:0:(genops.c:1385:class_connect()) connect: client 0f66e931-3201-4238-a1e4-162d21e5f09a, cookie 0x1d7ea3d89ea1bb8e 00000004:00100000:3.0:1788483231.747288:0:17224:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1788483231.747458:0:17224:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483231.747489:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2389:x1875360087136512:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 266us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.747498:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:2.0:1788483231.757263:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483231.757301:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483231.757399:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.758622:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136768 00000100:00100000:3.0:1788483231.758640:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136768 00000100:00100000:3.0:1788483231.758780:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136640 00000100:00100000:3.0:1788483231.758785:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136640 00000100:00100000:1.0:1788483231.759236:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136384 00000100:00100000:1.0:1788483231.759242:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136384 00000100:00100000:1.0:1788483231.759279:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:1.0:1788483231.759291:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+7:14915:x1875360087136768:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788483231.759341:0:17223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788483231.759450:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+7:14915:x1875360087136768:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 161us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.759458:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:1.0:1788483231.759478:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:1.0:1788483231.759485:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+6:0:x1875360087136384:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788483231.759498:0:17223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788483231.759521:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+6:0:x1875360087136384:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 37us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.759528:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00080000:2.0:1788483231.759900:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483231.759906:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483231.760062:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:3.0:1788483231.760072:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:0:x1875360087136640:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788483231.760093:0:17224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483231.760163:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:0:x1875360087136640:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 93us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.760182:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:2.0:1788483231.771978:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.777734:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087136896 00000100:00100000:3.0:1788483231.777756:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087136896 00000100:00100000:3.0:1788483231.778012:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788483231.778026:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:14915:x1875360087136896:12345-192.168.206.54@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788483231.778366:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:14915:x1875360087136896:12345-192.168.206.54@tcp:40:mount.lustre.0 Request processed in 340us (6409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483231.778375:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:3.0:1788483231.789284:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.789333:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483231.789371:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483231.789437:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137024 00000100:00100000:0.0:1788483231.789453:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137024 00000100:00100000:0.0:1788483231.789504:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137152 00000100:00100000:0.0:1788483231.789509:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137152 00000100:00100000:3.0:1788483231.789527:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788483231.789545:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875360087137024:12345-192.168.206.54@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788483231.789549:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:0.0:1788483231.789567:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875360087137152:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788483231.791292:0:19165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0f66e931-3201-4238-a1e4-162d21e5f09a@192.168.206.54@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1788483231.791349:0:19165:0:(genops.c:1385:class_connect()) connect: client 0f66e931-3201-4238-a1e4-162d21e5f09a, cookie 0x1d7ea3d89ea1bb95 00002000:00100000:1.0:1788483231.791366:0:19165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f66e931-3201-4238-a1e4-162d21e5f09a/ffff9a68c1fc1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788483231.791402:0:19165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788483231.791651:0:19165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788483231.791693:0:19165:0:(import.c:65:import_set_state_nolock()) ffff9a68c1fc2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483231.791795:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2389:x1875360087137024:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 2254us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.791813:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:2.0:1788483231.795329:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137280 00000100:00100000:2.0:1788483231.795356:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137280 00000100:00100000:2.0:1788483231.795484:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:2.0:1788483231.795496:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f66e931-3201-4238-a1e4-162d21e5f09a+6:14915:x1875360087137280:12345-192.168.206.54@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788483231.795605:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f66e931-3201-4238-a1e4-162d21e5f09a+6:14915:x1875360087137280:12345-192.168.206.54@tcp:900:mount.lustre.0 Request processed in 111us (6234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483231.795614:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:3.0:1788483231.799630:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483231.799745:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137408 00000100:00100000:0.0:1788483231.799771:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137408 00000100:00100000:0.0:1788483231.799834:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:0.0:1788483231.799845:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+6:14915:x1875360087137408:12345-192.168.206.54@tcp:33:mount.lustre.0 00010000:00080000:1.0:1788483231.803581:0:18729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0f66e931-3201-4238-a1e4-162d21e5f09a@192.168.206.54@tcp t0 exp 0000000000000000 cur 524 last 0 00000004:00080000:3.0:1788483231.804626:0:17225:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4703us 00000020:00000080:1.0:1788483231.807492:0:18729:0:(genops.c:1385:class_connect()) connect: client 0f66e931-3201-4238-a1e4-162d21e5f09a, cookie 0x1d7ea3d89ea1bb9c 00002000:00100000:1.0:1788483231.807521:0:18729:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f66e931-3201-4238-a1e4-162d21e5f09a/ffff9a68c1fc3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788483231.807539:0:18729:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788483231.809027:0:18729:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788483231.809084:0:18729:0:(import.c:65:import_set_state_nolock()) ffff9a68c1fc6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483231.809211:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2389:x1875360087137152:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 19643us (19874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483231.809226:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000001:00100000:2.0:1788483231.814419:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000001:00080000:2.0:1788483231.814442:0:19542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000004:00200000:0.0:1788483231.844928:0:17225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788483231.845141:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+6:14915:x1875360087137408:12345-192.168.206.54@tcp:33:mount.lustre.0 Request processed in 45289us (45517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483231.845154:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:3.0:1788483232.049746:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483232.049901:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137536 00000100:00100000:1.0:1788483232.049916:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137536 00000100:00100000:1.0:1788483232.050007:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:1.0:1788483232.050020:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+6:14962:x1875360087137536:12345-192.168.206.54@tcp:101:mkdir.0 00010000:00010000:1.0:1788483232.050047:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483232.050083:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e682 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483232.050450:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1bbaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483232.050467:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1bbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483232.050484:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1bbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483232.050692:0:17223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483232.050697:0:17223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483232.050742:0:17223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1bbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483232.050777:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e682 expref: 8 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483232.050811:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1bbaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e682 expref: 7 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483232.050821:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:1.0:1788483232.050824:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483232.050829:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b400, rc 0) 00000100:00100000:1.0:1788483232.050913:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+7:14962:x1875360087137536:12345-192.168.206.54@tcp:101:mkdir.0 Request processed in 895us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483232.051023:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00010000:00010000:0.0:1788483232.058093:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483233.016405:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788483233.016437:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098763008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483233.016525:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483233.016574:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098763136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483233.016597:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483233.016646:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763008 00000100:00100000:0.0:1788483233.016656:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763008 00000100:00100000:0.0:1788483233.016727:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763136 00000100:00100000:0.0:1788483233.016730:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763136 00000100:00100000:0.0:1788483233.016753:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483233.016764:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098763008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483233.016794:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483233.016864:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098763008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483233.016953:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098763008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788483233.017034:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483233.019671:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483233.019737:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483233.019760:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098763136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483233.019826:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483233.020199:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098763136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 450us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483233.020206:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483233.020765:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098763136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788483233.080406:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483234.040556:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098763264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483234.040664:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483234.040859:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763264 00000100:00100000:0.0:1788483234.040871:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763264 00000100:00100000:0.0:1788483234.040930:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788483234.040950:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098763264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483234.041004:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483234.041067:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098763264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.041073:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788483234.041253:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098763264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483234.041463:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483234.041475:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098763392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483234.041508:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483234.041597:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763392 00000100:00100000:1.0:1788483234.041604:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763392 00000100:00100000:1.0:1788483234.041643:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788483234.041651:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098763392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483234.041673:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788483234.041725:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098763392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483234.041732:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788483234.041835:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098763392:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788483234.104386:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483234.242023:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.242279:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137664 00000100:00100000:0.0:1788483234.242294:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137664 00000100:00100000:0.0:1788483234.242400:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00080000:3.0:1788483234.242418:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483234.242418:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+7:15014:x1875360087137664:12345-192.168.206.54@tcp:41:lfs.0 00000004:00000024:0.0:1788483234.242467:0:17224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483234.242731:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+7:15014:x1875360087137664:12345-192.168.206.54@tcp:41:lfs.0 Request processed in 320us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.242740:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:3.0:1788483234.251208:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.259681:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137792 00000100:00100000:0.0:1788483234.259704:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137792 00000100:00100000:0.0:1788483234.259809:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:0.0:1788483234.259825:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+6:15014:x1875360087137792:12345-192.168.206.54@tcp:41:lfs.0 00000004:00000024:0.0:1788483234.261165:0:18206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483234.261328:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+6:15014:x1875360087137792:12345-192.168.206.54@tcp:41:lfs.0 Request processed in 1503us (10130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.261338:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00080000:3.0:1788483234.263819:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483234.269421:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483234.269930:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087137920 00000100:00100000:1.0:1788483234.269943:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087137920 00000100:00100000:1.0:1788483234.270054:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:1.0:1788483234.270071:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f66e931-3201-4238-a1e4-162d21e5f09a+6:15014:x1875360087137920:12345-192.168.206.54@tcp:13:lfs.0 00002000:00000024:1.0:1788483234.270149:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788483234.270248:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f66e931-3201-4238-a1e4-162d21e5f09a+6:15014:x1875360087137920:12345-192.168.206.54@tcp:13:lfs.0 Request processed in 185us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483234.270256:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00080000:3.0:1788483234.270497:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483234.274234:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.275188:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138048 00000100:00100000:3.0:1788483234.275202:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138048 00000100:00100000:3.0:1788483234.275302:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:3.0:1788483234.275315:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15014:x1875360087138048:12345-192.168.206.54@tcp:13:lfs.0 00002000:00000024:3.0:1788483234.275356:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788483234.275468:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15014:x1875360087138048:12345-192.168.206.54@tcp:13:lfs.0 Request processed in 155us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.275476:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00080000:2.0:1788483234.276057:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483234.450549:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.450710:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138176 00000100:00100000:0.0:1788483234.450723:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138176 00000100:00100000:0.0:1788483234.450792:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 133 00000100:00100000:0.0:1788483234.450804:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:15046:x1875360087138176:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788483234.450842:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483234.450877:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1bbb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e689 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483234.450911:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1bbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e689 expref: 11 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483234.450923:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1bbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e689 expref: 11 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483234.450942:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8a00, rc 0) 00000100:00100000:0.0:1788483234.451022:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15046:x1875360087138176:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 220us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.451029:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 133 00000100:00100000:1.0:1788483234.455598:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.455775:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138304 00000100:00100000:0.0:1788483234.455788:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138304 00000100:00100000:0.0:1788483234.455912:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 134 00000100:00100000:0.0:1788483234.455926:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15046:x1875360087138304:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788483234.456192:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15046:x1875360087138304:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 268us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.456202:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 134 00000100:00100000:1.0:1788483234.460660:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.460758:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138432 00000100:00100000:3.0:1788483234.460771:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138432 00000100:00100000:3.0:1788483234.460845:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 135 00000100:00100000:3.0:1788483234.460857:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15046:x1875360087138432:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788483234.461233:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15046:x1875360087138432:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 376us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.461241:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 135 00000100:00100000:3.0:1788483234.473238:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.473764:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138560 00000100:00100000:0.0:1788483234.473779:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138560 00000100:00100000:0.0:1788483234.473863:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 136 00000100:00100000:0.0:1788483234.473875:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15053:x1875360087138560:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483234.474239:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15053:x1875360087138560:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 365us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.474255:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 136 00000100:00100000:1.0:1788483234.496531:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483234.496699:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138688 00000100:00100000:2.0:1788483234.496713:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138688 00000100:00100000:2.0:1788483234.496781:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:2.0:1788483234.496792:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15053:x1875360087138688:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788483234.497030:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15053:x1875360087138688:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 239us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483234.497039:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:1.0:1788483234.515817:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.515930:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138816 00000100:00100000:0.0:1788483234.515944:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138816 00000100:00100000:0.0:1788483234.516029:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00100000:0.0:1788483234.516051:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15053:x1875360087138816:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483234.516302:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15053:x1875360087138816:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 261us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.516311:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00100000:0.0:1788483234.521308:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.521417:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087138944 00000100:00100000:3.0:1788483234.521450:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087138944 00000100:00100000:3.0:1788483234.521520:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 139 00000100:00100000:3.0:1788483234.521532:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:15046:x1875360087138944:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788483234.521553:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483234.521576:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1bbb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e6ba expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.521620:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1bbb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6ba expref: 12 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.521634:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1bbb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6ba expref: 12 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.521646:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0600, rc 0) 00000100:00100000:3.0:1788483234.522197:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:15046:x1875360087138944:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 194us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.522208:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 139 00000100:00100000:1.0:1788483234.527523:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483234.527634:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139072 00000100:00100000:2.0:1788483234.527648:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139072 00000100:00100000:2.0:1788483234.527719:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 140 00000100:00100000:2.0:1788483234.527838:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:15046:x1875360087139072:12345-192.168.206.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788483234.528013:0:17215:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788483234.528035:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788483234.528040:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788483234.528461:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788483234.528467:0:17215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788483234.528470:0:17215:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788483234.532654:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:15046:x1875360087139072:12345-192.168.206.54@tcp:256:mount.lustre.0 Request processed in 4802us (5129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.532674:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 140 00000100:00100000:0.0:1788483234.536015:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.536295:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139200 00000100:00100000:3.0:1788483234.536309:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139200 00000100:00100000:3.0:1788483234.536418:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 141 00000100:00100000:3.0:1788483234.536433:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:15046:x1875360087139200:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788483234.536459:0:17216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483234.536483:0:17216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e6c1 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.536554:0:17216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 13 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.536568:0:17216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 13 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.536578:0:17216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0000, rc 0) 00000100:00100000:3.0:1788483234.536654:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15046:x1875360087139200:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 225us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.536661:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 141 00000100:00100000:1.0:1788483234.539320:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.539373:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139328 00000100:00100000:3.0:1788483234.539384:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139328 00000100:00100000:3.0:1788483234.539437:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:3.0:1788483234.539448:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15046:x1875360087139328:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788483234.539638:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15046:x1875360087139328:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 191us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.539646:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:1.0:1788483234.541640:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.542016:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139456 00000100:00100000:3.0:1788483234.542029:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139456 00000100:00100000:3.0:1788483234.542181:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00100000:3.0:1788483234.542193:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15046:x1875360087139456:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788483234.542374:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15046:x1875360087139456:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 183us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.542383:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00100000:0.0:1788483234.548698:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.549306:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139584 00000100:00100000:3.0:1788483234.549338:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139584 00000100:00100000:3.0:1788483234.549832:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 144 00000100:00100000:3.0:1788483234.549847:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15058:x1875360087139584:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788483234.550056:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15058:x1875360087139584:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 211us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.550074:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 144 00000100:00100000:1.0:1788483234.558525:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.564626:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139712 00000100:00100000:0.0:1788483234.564649:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139712 00000100:00100000:0.0:1788483234.564765:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 145 00000100:00100000:0.0:1788483234.564778:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15058:x1875360087139712:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483234.565023:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:15058:x1875360087139712:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 247us (6511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.565032:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 145 00000100:00100000:1.0:1788483234.570704:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483234.571225:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483234.584508:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139840 00000100:00100000:2.0:1788483234.584529:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139840 00000100:00100000:2.0:1788483234.584603:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140096 00000100:00100000:2.0:1788483234.584607:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140096 00000100:00100000:2.0:1788483234.584653:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:3.0:1788483234.584891:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:3.0:1788483234.584899:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2389:x1875360087140096:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788483234.584963:0:18206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6@192.168.206.54@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:3.0:1788483234.585016:0:18206:0:(genops.c:1385:class_connect()) connect: client ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6, cookie 0x1d7ea3d89ea1bbc6 00000004:00100000:3.0:1788483234.585051:0:18206:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1788483234.585211:0:18206:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483234.585298:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2389:x1875360087140096:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 397us (14073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.585306:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:2.0:1788483234.586215:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1875360087139840:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788483234.586248:0:17222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6@192.168.206.54@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1788483234.586280:0:17222:0:(genops.c:1385:class_connect()) connect: client ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6, cookie 0x1d7ea3d89ea1bbcd 00000004:00100000:2.0:1788483234.586300:0:17222:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788483234.586373:0:17222:0:(import.c:65:import_set_state_nolock()) ffff9a69f4519000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483234.586424:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2389:x1875360087139840:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 1761us (15739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483234.586433:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:1.0:1788483234.591976:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.592323:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140224 00000100:00100000:3.0:1788483234.592337:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140224 00000100:00100000:3.0:1788483234.592429:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788483234.592441:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:0:x1875360087140224:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788483234.592480:0:18206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483234.592560:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:0:x1875360087140224:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 122us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.592568:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:1.0:1788483234.593215:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483234.593260:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140352 00000100:00100000:1.0:1788483234.593267:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140352 00000100:00100000:1.0:1788483234.593309:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:1.0:1788483234.593317:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140352:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788483234.593350:0:17223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788483234.593393:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140352:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483234.593418:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00080000:2.0:1788483234.595619:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483234.595634:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483234.597557:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483234.597650:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140480 00000100:00100000:2.0:1788483234.597664:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140480 00000100:00100000:2.0:1788483234.597894:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:2.0:1788483234.597907:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140480:12345-192.168.206.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788483234.599672:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140480:12345-192.168.206.54@tcp:40:mount.lustre.0 Request processed in 1747us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483234.599710:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788483234.600764:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483234.600928:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087139968 00000100:00100000:0.0:1788483234.600939:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087139968 00000100:00100000:0.0:1788483234.601012:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:0.0:1788483234.601024:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:0:x1875360087139968:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788483234.601052:0:17224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483234.601163:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:0:x1875360087139968:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 141us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.601182:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:3.0:1788483234.606174:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483234.606994:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140608 00000100:00100000:1.0:1788483234.607009:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140608 00000100:00100000:1.0:1788483234.607079:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:1.0:1788483234.607088:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875360087140608:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788483234.607156:0:18731:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6@192.168.206.54@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1788483234.607198:0:18731:0:(genops.c:1385:class_connect()) connect: client ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6, cookie 0x1d7ea3d89ea1bbd4 00002000:00100000:1.0:1788483234.607212:0:18731:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6/ffff9a68c36e4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788483234.607225:0:18731:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788483234.607329:0:18731:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788483234.607369:0:18731:0:(import.c:65:import_set_state_nolock()) ffff9a68c36e3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483234.607462:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2389:x1875360087140608:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 373us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483234.607471:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:1.0:1788483234.618375:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483234.618436:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483234.618547:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140864 00000100:00100000:2.0:1788483234.618560:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140864 00000100:00100000:2.0:1788483234.618631:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:2.0:1788483234.618643:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140864:12345-192.168.206.54@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788483234.618769:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140864:12345-192.168.206.54@tcp:900:mount.lustre.0 Request processed in 126us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483234.618778:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:0.0:1788483234.619023:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140736 00000100:00100000:0.0:1788483234.619033:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140736 00000100:00100000:0.0:1788483234.619079:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:0.0:1788483234.619085:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875360087140736:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788483234.619147:0:19165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6@192.168.206.54@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1788483234.619186:0:19165:0:(genops.c:1385:class_connect()) connect: client ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6, cookie 0x1d7ea3d89ea1bbdb 00002000:00100000:0.0:1788483234.619201:0:19165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6/ffff9a69f6ab6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788483234.619215:0:19165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788483234.619330:0:19165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788483234.619367:0:19165:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d34800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483234.619410:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2389:x1875360087140736:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 324us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483234.619417:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:2.0:1788483234.622837:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.623467:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087140992 00000100:00100000:3.0:1788483234.623480:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087140992 00000100:00100000:3.0:1788483234.623535:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:3.0:1788483234.623612:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140992:12345-192.168.206.54@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788483234.624202:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788483234.624376:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15046:x1875360087140992:12345-192.168.206.54@tcp:33:mount.lustre.0 Request processed in 828us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.624386:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:1.0:1788483234.819509:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483234.819679:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087141120 00000100:00100000:3.0:1788483234.819692:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087141120 00000100:00100000:3.0:1788483234.819828:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788483234.820011:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15081:x1875360087141120:12345-192.168.206.54@tcp:101:mkdir.0 00010000:00010000:3.0:1788483234.820041:0:18206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483234.820369:0:18206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1800/0x1d7ea3d89ea1bbe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e6f2 expref: -99 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.820455:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.820471:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.820486:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483234.820539:0:18206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788483234.820543:0:18206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483234.821170:0:18206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.821229:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1800/0x1d7ea3d89ea1bbe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 8 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.821251:0:18206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 7 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483234.821262:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:3.0:1788483234.821265:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483234.821269:0:18206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1600, rc 0) 00000100:00100000:3.0:1788483234.821362:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+7:15081:x1875360087141120:12345-192.168.206.54@tcp:101:mkdir.0 Request processed in 1523us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483234.821372:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00010000:00010000:0.0:1788483235.128629:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483235.577339:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788483236.153571:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483236.602267:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098763776:0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.602515:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098763648:0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.602625:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483236.602682:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098764160:0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.602712:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483236.602736:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098764672:0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.602758:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483236.602776:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098765184:0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.602798:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483236.602843:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764160 00000100:00100000:2.0:1788483236.602851:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764160 00000100:00100000:2.0:1788483236.602899:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764672 00000100:00100000:2.0:1788483236.602902:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764672 00000100:00100000:3.0:1788483236.603130:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483236.603159:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098764288:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.603231:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483236.603252:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098764800:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.603273:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483236.603288:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098765312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483236.603299:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098763520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483236.603315:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483236.603335:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098763904:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603364:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483236.603385:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098764416:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603408:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483236.603428:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098764928:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603448:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483236.603473:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098765184 00000100:00100000:0.0:1788483236.603485:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098765184 00000100:00100000:0.0:1788483236.603514:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764800 00000100:00100000:2.0:1788483236.603515:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764928 00000100:00100000:0.0:1788483236.603517:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764800 00000100:00100000:0.0:1788483236.603536:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788483236.603548:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098764160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603605:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098764160:12345-0@lo:400:kworker.0 Request processed in 59us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.603613:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788483236.603637:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788483236.603644:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098764672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603671:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098764672:12345-0@lo:400:kworker.0 Request processed in 29us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.603677:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788483236.603687:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788483236.603693:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098765184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.603718:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764928 00000100:00100000:0.0:1788483236.603718:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098765184:12345-0@lo:400:kworker.0 Request processed in 26us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.603724:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788483236.603737:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788483236.603741:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483236.603742:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098764800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.603746:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098764928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603768:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098764800:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.603774:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788483236.603783:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098764928:12345-0@lo:400:kworker.0 Request processed in 37us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483236.603789:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483236.603815:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098764160:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603827:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098764672:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.603842:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763648 00000100:00100000:3.0:1788483236.603846:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763648 00010000:00080000:0.0:1788483236.603850:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca4000 x1875360098765184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483236.603861:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098765184:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.603884:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788483236.603891:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098763648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.603893:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483236.603914:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098764032:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.605567:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483236.605585:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098763648:12345-0@lo:400:kworker.0 Request processed in 1693us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483236.605606:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788483236.605639:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098764544:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.605666:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483236.605716:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763904 00000100:00100000:1.0:1788483236.605722:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763904 00000100:00100000:2.0:1788483236.605727:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098763648:0@lo:400:kworker.0 00000100:00100000:2.0:1788483236.605759:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764416 00000100:00100000:1.0:1788483236.605761:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764032 00000100:00100000:2.0:1788483236.605763:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764416 00000100:00100000:1.0:1788483236.605763:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764032 00000100:00100000:1.0:1788483236.605776:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764544 00000100:00100000:1.0:1788483236.605779:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764544 00000100:00100000:2.0:1788483236.605783:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483236.605790:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098763904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483236.605791:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788483236.605802:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098764032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.605847:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098765056:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.605874:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483236.605908:0:18731:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788483236.605917:0:18731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788483236.605936:0:18730:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788483236.605954:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483236.605962:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098764416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.605996:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098764416:12345-0@lo:400:kworker.0 Request processed in 35us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.606002:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483236.606014:0:18730:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788483236.606020:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483236.606026:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098764544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.606054:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098764544:12345-0@lo:400:kworker.0 Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.606059:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788483236.606075:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483236.606085:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483236.606088:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483236.606092:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788483236.606138:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098764416:0@lo:400:kworker.0 00010000:00080000:0.0:1788483236.606154:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c1ca7b80 x1875360098764928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483236.606178:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098764928:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.606203:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098765312 00000100:00100000:0.0:1788483236.606208:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098765312 00000100:00100000:0.0:1788483236.606227:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763520 00000100:00100000:0.0:1788483236.606230:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763520 00000100:00100000:0.0:1788483236.606241:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483236.606246:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098765312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483236.606271:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788483236.606305:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098765312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.606311:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483236.606322:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788483236.606328:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098763520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483236.606355:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788483236.606383:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098763520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.606390:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788483236.606409:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098765056 00000100:00100000:0.0:1788483236.606413:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098765056 00000100:00100000:0.0:1788483236.606447:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788483236.606454:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098765056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.606492:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098765056:12345-0@lo:400:kworker.0 Request processed in 39us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483236.606499:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788483236.606502:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098763776 00000100:00100000:3.0:1788483236.606508:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098763776 00000100:00100000:3.0:1788483236.606538:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098764288 00000100:00100000:3.0:1788483236.606541:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098764288 00000100:00100000:3.0:1788483236.606553:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788483236.606559:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098763776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.606597:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098763776:12345-0@lo:400:kworker.0 Request processed in 39us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483236.606603:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788483236.606614:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788483236.606618:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098764288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.606642:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098764288:12345-0@lo:400:kworker.0 Request processed in 24us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483236.606648:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788483236.606669:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098763520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483236.606679:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098764544:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.606683:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788483236.606688:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098765056:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.606699:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098765312:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788483236.606706:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483236.606712:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098763776:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.606723:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098764288:0@lo:400:kworker.0 00000100:00100000:3.0:1788483236.606737:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098764800:0@lo:400:kworker.0 00000100:00100000:1.0:1788483236.607045:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098764032:12345-0@lo:400:kworker.0 Request processed in 1241us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483236.607053:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098763904:12345-0@lo:400:kworker.0 Request processed in 1263us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483236.607053:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483236.607060:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483236.607262:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098764032:0@lo:400:kworker.0 00000100:00100000:0.0:1788483236.607299:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098763904:0@lo:400:kworker.0 00010000:00010000:2.0:1788483237.177878:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788483237.627963:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00100000:1.0:1788483237.627982:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000001:00100000:0.0:1788483237.628297:0:17955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00100000:0.0:1788483237.628308:0:17955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000001:00100000:3.0:1788483237.635972:0:17202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00100000:3.0:1788483237.635989:0:17202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000001:02000400:2.0:1788483237.964053:0:20101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788483238.139718:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098765440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483238.139812:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483238.139888:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098765440 00000100:00100000:0.0:1788483238.139897:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098765440 00000100:00100000:0.0:1788483238.139979:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788483238.139991:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098765440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483238.140028:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483238.140077:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098765440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483238.140084:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788483238.140132:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483238.140173:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098765440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483238.141367:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098765568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483238.141433:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483238.141649:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098765568 00000100:00100000:3.0:1788483238.141657:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098765568 00000100:00100000:3.0:1788483238.141725:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788483238.141733:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098765568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483238.141754:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483238.141802:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098765568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483238.141809:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788483238.141872:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483238.141908:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098765568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788483238.208985:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483239.161878:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483239.164175:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483239.164203:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098765824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483239.164298:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483239.164443:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098765824 00000100:00100000:1.0:1788483239.164454:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098765824 00000100:00100000:1.0:1788483239.164523:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788483239.164534:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098765824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483239.164588:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788483239.164643:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098765824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483239.164650:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483239.164801:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098765824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483239.167087:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098765696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483239.167203:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483239.167496:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098765696 00000100:00100000:3.0:1788483239.167506:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098765696 00000100:00100000:3.0:1788483239.171261:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788483239.171293:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098765696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788483239.171344:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483239.171456:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098765696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483239.171465:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788483239.171835:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098765696:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788483239.237468:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483240.077784:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483240.077841:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087141248 00000100:00100000:1.0:1788483240.077847:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483240.077855:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087141248 00000100:00100000:1.0:1788483240.077892:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483240.077920:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483240.077942:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 147 00000100:00100000:0.0:1788483240.077956:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2392:x1875360087141248:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483240.077963:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483240.077982:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087141504 00000100:00100000:2.0:1788483240.077988:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087141504 00000100:00100000:1.0:1788483240.077988:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483240.078007:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483240.078034:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142016 00000100:00100000:2.0:1788483240.078037:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142016 00000100:00100000:1.0:1788483240.078041:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483240.078051:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087141376 00000100:00100000:2.0:1788483240.078053:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087141376 00000100:00100000:1.0:1788483240.078060:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483240.078064:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087141888 00000100:00100000:2.0:1788483240.078067:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087141888 00000100:00100000:2.0:1788483240.078082:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:1.0:1788483240.078087:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:2.0:1788483240.078089:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087141504:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483240.078118:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087142016:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483240.078166:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087141504:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 76us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483240.078166:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087142016:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483240.078180:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:0.0:1788483240.078181:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2392:x1875360087141248:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 224us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483240.078186:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:0.0:1788483240.078197:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 147 00000100:00100000:1.0:1788483240.078202:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:2.0:1788483240.078206:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:1.0:1788483240.078209:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2392:x1875360087141376:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483240.078212:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2392:x1875360087141888:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483240.078242:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2392:x1875360087141888:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483240.078242:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2392:x1875360087141376:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483240.078248:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087141760 00000100:00100000:2.0:1788483240.078251:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:0.0:1788483240.078255:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087141760 00000100:00100000:1.0:1788483240.078260:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:1.0:1788483240.078283:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142272 00000100:00100000:1.0:1788483240.078288:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142272 00000100:00100000:0.0:1788483240.078307:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087141632 00000100:00100000:0.0:1788483240.078312:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087141632 00000100:00100000:1.0:1788483240.078315:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142144 00000100:00100000:1.0:1788483240.078320:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142144 00000100:00100000:2.0:1788483240.078331:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:2.0:1788483240.078339:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087141760:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483240.078348:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:1.0:1788483240.078354:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2392:x1875360087142272:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483240.078374:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087141760:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 36us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483240.078374:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2392:x1875360087142272:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 20us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483240.078410:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:0.0:1788483240.078421:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087141632:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483240.078466:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087141632:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 48us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483240.078474:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:0.0:1788483240.078489:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:0.0:1788483240.078497:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087142144:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483240.078536:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087142144:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 40us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483240.078544:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:2.0:1788483240.078790:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:1.0:1788483240.078796:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00080000:0.0:1788483240.078856:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483240.078862:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483240.078865:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483240.078867:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788483240.248949:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483240.251955:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1788483240.699332:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00010000:00010000:0.0:1788483241.281543:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788483241.669710:0:20248:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff11384250 20000000:00000080:1.0:1788483241.669735:0:20248:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a69f5218800 uarg=0000000000000000 20000000:01000000:1.0:1788483241.669786:0:20248:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788483241.669792:0:20248:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788483241.669798:0:20248:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788483241.671002:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788483241.671448:0:20248:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788483241.677277:0:20248:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788483241.677562:0:20248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677581:0:20248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677589:0:20248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677595:0:20248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677601:0:20248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677609:0:20248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 12 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677617:0:20248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 12 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677624:0:20248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677669:0:20248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 12 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677695:0:20248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 12 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.677711:0:20248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098765952:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483241.677859:0:20248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 12 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.677867:0:20248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 12 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.677875:0:20248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766080:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483241.678057:0:20248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.678066:0:20248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 23 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.678076:0:20248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766208:0@lo:104: 00000100:00100000:0.0:1788483241.678192:0:20248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483241.678226:0:20248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.678234:0:20248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 23 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.678242:0:20248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766336:0@lo:104: 00000100:00100000:0.0:1788483241.678261:0:20248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483241.678331:0:20248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.678339:0:20248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 23 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.678347:0:20248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766464:0@lo:104: 00000100:00100000:0.0:1788483241.678365:0:20248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483241.678936:0:20248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.678946:0:20248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 23 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.678956:0:20248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766592:0@lo:104: 00000100:00100000:0.0:1788483241.678980:0:20248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.679083:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098766208 00000100:00100000:3.0:1788483241.679091:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098766208 00000100:00100000:3.0:1788483241.679154:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098766336 00000100:00100000:3.0:1788483241.679158:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098766336 00000100:00100000:3.0:1788483241.679168:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098766464 00000100:00100000:3.0:1788483241.679171:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098766464 00000100:00100000:3.0:1788483241.679182:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483241.679190:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+5:20248:x1875360098766208:12345-0@lo:104: 00010000:00010000:3.0:1788483241.679209:0:17205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679253:0:17205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483241.679259:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+5:20248:x1875360098766208:12345-0@lo:104: Request processed in 69us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.679266:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483241.679282:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483241.679287:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:20248:x1875360098766336:12345-0@lo:104: 00010000:00010000:3.0:1788483241.679294:0:17205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679328:0:17205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788483241.679333:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+4:20248:x1875360098766336:12345-0@lo:104: Request processed in 46us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.679339:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483241.679350:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483241.679356:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:20248:x1875360098766464:12345-0@lo:104: 00010000:00010000:3.0:1788483241.679364:0:17205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679395:0:17205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788483241.679399:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:20248:x1875360098766464:12345-0@lo:104: Request processed in 44us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.679405:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788483241.679421:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788483241.679426:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679440:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483241.679445:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679452:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483241.679459:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483241.679464:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483241.679490:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679497:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483241.679515:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679522:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76c00/0x1d7ea3d89ea1ba30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1ba37 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679534:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483241.679537:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679542:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483241.679544:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679560:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483241.679565:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483241.679570:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483241.679581:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679585:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483241.679590:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679596:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76200/0x1d7ea3d89ea1b8cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b8d2 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679603:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483241.679605:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679610:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483241.679612:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679618:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483241.679623:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483241.679632:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483241.679642:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679646:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483241.679658:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679664:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9400/0x1d7ea3d89ea1b88c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b893 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.679671:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483241.679673:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483241.679674:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483241.679679:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483241.679695:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098766720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483241.679720:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.679741:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483241.679746:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098766848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483241.679761:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.679781:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098766976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483241.679798:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.679826:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098766720 00000100:00100000:3.0:1788483241.679830:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098766720 00010000:00010000:3.0:1788483241.679843:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 24 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483241.679854:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098766848 00000100:00100000:3.0:1788483241.679860:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098766848 00010000:00010000:3.0:1788483241.679869:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 25 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483241.680030:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483241.680269:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483241.680279:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+25:3621:x1875360098766720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483241.680289:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483241.680294:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 25 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483241.680304:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 25 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483241.680319:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483241.680351:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+25:3621:x1875360098766720:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483241.680363:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483241.680378:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483241.680383:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3621:x1875360098766848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483241.680390:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483241.680395:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 24 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483241.680402:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 24 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483241.680410:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483241.680430:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3621:x1875360098766848:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483241.680435:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483241.680645:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098766976 00000100:00100000:3.0:1788483241.680650:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098766976 00010000:00010000:3.0:1788483241.680667:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 24 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483241.680726:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483241.680733:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098766976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483241.680742:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483241.680746:0:17207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 24 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.680754:0:17207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 24 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483241.680763:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483241.680794:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098766976:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.680800:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483241.680903:0:20248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d429c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788483241.680937:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76e00/0x1d7ea3d89ea1ba37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1ba30 expref: 23 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.680949:0:20248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766208:0@lo:104: 00010000:00010000:0.0:1788483241.680959:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3600/0x1d7ea3d89ea1b8d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b8cb expref: 22 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.680967:0:20248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766336:0@lo:104: 00010000:00010000:0.0:1788483241.680975:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1b893 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b88c expref: 21 pid: 17215 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.680982:0:20248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766464:0@lo:104: 00000100:00100000:1.0:1788483241.681152:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098766592 00000100:00100000:1.0:1788483241.681157:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098766592 00000100:00100000:1.0:1788483241.681187:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788483241.681194:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:20248:x1875360098766592:12345-0@lo:104: 00010000:00010000:1.0:1788483241.681206:0:17206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.681255:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788483241.681261:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+3:20248:x1875360098766592:12345-0@lo:104: Request processed in 68us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483241.681266:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483241.681543:0:20248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766592:0@lo:104: 00000100:00100000:2.0:1788483241.682184:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098766976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483241.682217:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098766848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483241.682225:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098766720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483241.682285:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483241.682291:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682300:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77000 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483241.682303:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682311:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483241.682319:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483241.682324:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788483241.682364:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682370:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483241.682388:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682395:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77000/0x1d7ea3d89ea1b87e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1b885 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682408:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483241.682410:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483241.682412:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483241.682461:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483241.682472:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098767104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483241.682518:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483241.682596:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098767104 00000100:00100000:0.0:1788483241.682601:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098767104 00010000:00010000:0.0:1788483241.682624:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 21 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.682666:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483241.682674:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3619:x1875360098767104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483241.682686:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483241.682691:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 21 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682713:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 21 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682726:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9600/0x1d7ea3d89ea1b885 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1b87e expref: 21 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.682737:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483241.682766:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:3619:x1875360098767104:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483241.682772:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483241.682837:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098767104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483241.686419:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483241.686595:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483241.686623:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142400 00000100:00100000:1.0:1788483241.686632:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142400 00010000:00010000:1.0:1788483241.686665:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 13 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483241.686694:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142528 00000100:00100000:1.0:1788483241.686698:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142528 00010000:00010000:1.0:1788483241.686710:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 14 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483241.686723:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:1.0:1788483241.686801:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f7386850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+14:2393:x1875360087142400:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483241.686815:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483241.686821:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 14 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.686832:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 14 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.686864:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483241.687032:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f7386850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+14:2393:x1875360087142400:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 232us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483241.687038:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:1.0:1788483241.687078:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:1.0:1788483241.687084:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2392:x1875360087142528:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483241.687092:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483241.687122:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 13 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687132:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 13 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687144:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687152:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687167:0:17209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687173:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687179:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687185:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687196:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483241.687200:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687207:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687215:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483241.687223:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483241.687241:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2392:x1875360087142528:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 156us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483241.687247:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00010000:00010000:0.0:1788483241.687472:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0000/0x1d7ea3d89ea1bbbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6c1 expref: 12 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.687486:0:20248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098765952:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483241.687498:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2e00/0x1d7ea3d89ea1bb80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e651 expref: 11 pid: 17216 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483241.687506:0:20248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20248:1875360098766080:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483241.687535:0:20248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.687553:0:20248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.687559:0:20248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483241.687565:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bbf0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483241.722482:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098767232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483241.722550:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483241.722635:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098767232 00000100:00100000:1.0:1788483241.722642:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098767232 00000100:00100000:1.0:1788483241.722694:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788483241.722703:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098767232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483241.722728:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788483241.722764:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098767232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483241.722771:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788483241.722815:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483241.722856:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098767232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483241.730765:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098767616:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.730823:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.730849:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098768128:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.730873:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.730890:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098768640:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.730909:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.730943:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788483241.730956:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098767488:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.730982:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.730999:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098768000:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.731018:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.731032:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098768512:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.731052:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483241.731079:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768128 00000100:00100000:3.0:1788483241.731085:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768128 00000100:00100000:3.0:1788483241.731139:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768640 00000100:00100000:3.0:1788483241.731142:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768640 00000100:00100000:3.0:1788483241.731161:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768512 00000100:00100000:3.0:1788483241.731163:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768512 00000100:00100000:3.0:1788483241.731177:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483241.731185:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098768128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.731235:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098768128:12345-0@lo:400:kworker.0 Request processed in 51us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.731241:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483241.731256:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788483241.731262:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098768640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.731287:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098768640:12345-0@lo:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.731293:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788483241.731305:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788483241.731311:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098768512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.731334:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098768512:12345-0@lo:400:kworker.0 Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.731339:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788483241.731363:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098767616 00000100:00100000:3.0:1788483241.731366:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098767616 00000100:00100000:1.0:1788483241.731540:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768000 00000100:00100000:1.0:1788483241.731544:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768000 00000100:00100000:1.0:1788483241.731569:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788483241.731576:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098767616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483241.731610:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098767616:12345-0@lo:400:kworker.0 Request processed in 35us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483241.731624:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788483241.731637:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788483241.731643:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098768000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483241.731671:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098768000:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483241.731676:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483241.731991:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098767360:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732022:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483241.732060:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098767872:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732080:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483241.732119:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098768384:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732141:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483241.732160:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788483241.732166:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098767744:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732184:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483241.732198:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098768256:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732213:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483241.732225:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098768768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483241.732244:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483241.732268:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098767360 00000100:00100000:0.0:1788483241.732273:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098767360 00000100:00100000:0.0:1788483241.732297:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098767872 00000100:00100000:0.0:1788483241.732300:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098767872 00000100:00100000:0.0:1788483241.732322:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788483241.732328:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098767360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732365:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098767360:12345-0@lo:400:kworker.0 Request processed in 38us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483241.732372:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788483241.732385:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788483241.732391:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098767872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732414:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098767872:12345-0@lo:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483241.732419:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788483241.732435:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768384 00000100:00100000:0.0:1788483241.732438:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768384 00000100:00100000:0.0:1788483241.732457:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098767744 00000100:00100000:0.0:1788483241.732459:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098767744 00000100:00100000:0.0:1788483241.732466:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768256 00000100:00100000:0.0:1788483241.732468:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768256 00000100:00100000:0.0:1788483241.732480:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788483241.732486:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098768384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732514:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098768384:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483241.732519:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788483241.732531:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483241.732536:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098767744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732558:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098767744:12345-0@lo:400:kworker.0 Request processed in 22us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483241.732563:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483241.732572:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483241.732584:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098768256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732610:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098768256:12345-0@lo:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483241.732616:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483241.732635:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768768 00000100:00100000:0.0:1788483241.732638:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768768 00000100:00100000:0.0:1788483241.732658:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483241.732663:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098768768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483241.732676:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788483241.732703:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098768768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483241.732709:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483241.732741:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098767744:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732752:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098768256:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732765:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098768768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483241.732773:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098767360:0@lo:400:kworker.0 00000100:00100000:0.0:1788483241.732780:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098767872:0@lo:400:kworker.0 00010000:00080000:0.0:1788483241.732789:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3074700 x1875360098768384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483241.732799:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098768384:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.734678:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098767488 00000100:00100000:3.0:1788483241.734690:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098767488 00000100:00100000:3.0:1788483241.734743:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788483241.734751:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d06ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098767488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.734819:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d06ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098767488:12345-0@lo:400:kworker.0 Request processed in 70us (3836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483241.734825:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788483241.735345:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483241.735350:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483241.735353:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483241.735356:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483241.735388:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098767488:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.735401:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098768000:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.735411:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098768512:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.735422:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098767616:0@lo:400:kworker.0 00000100:00100000:3.0:1788483241.735433:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098768128:0@lo:400:kworker.0 00010000:00080000:3.0:1788483241.735446:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3077b80 x1875360098768640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483241.735455:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098768640:0@lo:400:kworker.0 00010000:00010000:3.0:1788483242.296453:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483242.957937:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483242.957990:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142656 00000100:00100000:1.0:1788483242.958002:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142656 00000100:00100000:1.0:1788483242.958077:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00100000:1.0:1788483242.958089:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:14929:x1875360087142656:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483242.958133:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483242.958160:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1bbf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e6f9 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483242.958200:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1bbf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f9 expref: 12 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483242.958212:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1bbf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f9 expref: 12 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483242.958223:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8be00, rc 0) 00000100:00100000:1.0:1788483242.958286:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:14929:x1875360087142656:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 200us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483242.958294:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00100000:1.0:1788483242.972712:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483242.974152:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142784 00000100:00100000:2.0:1788483242.974735:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142784 00000100:00100000:2.0:1788483242.976668:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 149 00000100:00100000:2.0:1788483242.976690:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:14929:x1875360087142784:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483242.978818:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:14929:x1875360087142784:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 2124us (6110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483242.983139:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483242.983514:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 149 00000100:00100000:3.0:1788483242.983731:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087142912 00000100:00100000:3.0:1788483242.983742:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087142912 00000100:00100000:3.0:1788483242.983821:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:3.0:1788483242.983835:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:14929:x1875360087142912:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483242.984045:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:14929:x1875360087142912:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 214us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483242.984053:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:1.0:1788483242.992603:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483242.992714:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143040 00000100:00100000:3.0:1788483242.992727:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143040 00000100:00100000:3.0:1788483242.992797:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:3.0:1788483242.992809:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:14929:x1875360087143040:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483242.992831:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483242.992853:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1bbfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e700 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483242.992891:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1bbfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e700 expref: 13 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483242.992919:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1bbfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e700 expref: 13 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483242.992931:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1800, rc 0) 00000100:00100000:3.0:1788483242.993011:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:14929:x1875360087143040:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 203us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483242.993019:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:2.0:1788483243.005489:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483243.005580:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143168 00000100:00100000:1.0:1788483243.005591:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143168 00000100:00100000:1.0:1788483243.005653:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00100000:1.0:1788483243.005662:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:14929:x1875360087143168:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483243.005830:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:14929:x1875360087143168:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 168us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483243.005839:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00100000:0.0:1788483243.021637:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483243.021751:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143296 00000100:00100000:1.0:1788483243.021764:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143296 00000100:00100000:1.0:1788483243.022088:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:1.0:1788483243.022151:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:14929:x1875360087143296:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.022467:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:14929:x1875360087143296:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 318us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.022487:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:3.0:1788483243.259565:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483243.259596:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098769024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483243.259692:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483243.259751:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769024 00000100:00100000:3.0:1788483243.259768:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769024 00000100:00100000:3.0:1788483243.259837:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788483243.259849:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098769024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483243.259899:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483243.259970:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098769024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483243.259977:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788483243.260001:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483243.260043:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098769024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483243.260200:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098768896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483243.260235:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483243.260304:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098768896 00000100:00100000:3.0:1788483243.260308:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098768896 00000100:00100000:3.0:1788483243.260342:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483243.260348:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098768896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483243.260360:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483243.260390:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098768896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483243.260396:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788483243.260458:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098768896:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788483243.260475:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788483243.321207:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788483243.384857:0:17219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788483243.384865:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c331b000 from 13 10000000:01000000:2.0:1788483243.384871:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788483243.384947:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483243.384961:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483243.384975:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483243.385003:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788483243.385126:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483243.385174:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483243.385207:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769152 00000100:00100000:2.0:1788483243.385214:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769152 00000100:00100000:2.0:1788483243.385269:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788483243.385278:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:17219:x1875360098769152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483243.385293:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483243.385308:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1bc0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bc05 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483243.385333:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1bc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc05 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483243.385344:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1bc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc05 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483243.385356:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77a00, rc 0) 00000100:00100000:2.0:1788483243.385404:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098769152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483243.385411:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788483243.385476:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483243.385491:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483243.385502:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483243.386326:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483243.386374:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483243.386396:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725480 going to sleep for 11 seconds 00000100:00100000:0.0:1788483243.386486:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769280 00000100:00100000:0.0:1788483243.386492:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769280 00000100:00100000:0.0:1788483243.386998:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788483243.387009:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098769280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.387314:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098769280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.387323:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788483243.388394:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483243.388455:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483243.388653:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483243.388693:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c9725480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483243.388711:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769408 00000100:00100000:2.0:1788483243.388718:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769408 00000100:00100000:2.0:1788483243.388760:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788483243.388767:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098769408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483243.388874:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098769408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483243.388883:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788483243.388939:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788483243.394771:0:20309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788483243.404893:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788483243.404949:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483243.404963:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.404979:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483243.405033:0:17219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788483243.405036:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d0564000 from 13 10000000:01000000:0.0:1788483243.405039:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788483243.405084:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.405092:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.406843:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483243.406876:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.406980:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483243.407035:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769536 00000100:00100000:0.0:1788483243.407043:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769536 00000100:00100000:0.0:1788483243.407113:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788483243.407123:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c50c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:17219:x1875360098769536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483243.407139:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483243.407158:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1bc1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bc13 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.409643:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1bc1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc13 expref: 22 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.409672:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1bc1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc13 expref: 22 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.409685:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d8c00, rc 0) 00000100:00100000:0.0:1788483243.409771:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c50c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:17219:x1875360098769536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2648us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.409781:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788483243.409862:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483243.409888:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483243.409921:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.409933:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483243.410023:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.410066:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483243.410093:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769664 00000100:00100000:0.0:1788483243.410112:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769664 00000100:00100000:0.0:1788483243.410148:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788483243.410159:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:17219:x1875360098769664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.412435:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:17219:x1875360098769664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2272us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.412450:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788483243.413450:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483243.413486:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.413605:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.413662:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483243.413693:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769792 00000100:00100000:0.0:1788483243.413700:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769792 00000100:00100000:0.0:1788483243.413741:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788483243.413749:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:17219:x1875360098769792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.413838:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:17219:x1875360098769792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.413845:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788483243.413879:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483243.413889:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788483243.417944:0:20311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788483243.418067:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788483243.418088:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483243.418150:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.418172:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483243.428366:0:17219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788483243.428378:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c3dba000 from 13 10000000:01000000:0.0:1788483243.428385:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788483243.428448:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.428463:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.428477:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483243.428507:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.428607:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483243.428679:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098769920 00000100:00100000:0.0:1788483243.428688:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098769920 00000100:00100000:0.0:1788483243.428745:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788483243.428754:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:17219:x1875360098769920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483243.428768:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483243.428782:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bc28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bc21 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.428810:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bc28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc21 expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.428821:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bc28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc21 expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.428847:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9c00, rc 0) 00000100:00100000:0.0:1788483243.428880:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098769920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.428887:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788483243.428954:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f8d423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483243.428976:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098769920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483243.428993:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.429003:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483243.429062:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.429085:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483243.429130:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098770048 00000100:00100000:0.0:1788483243.429134:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098770048 00000100:00100000:0.0:1788483243.429153:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788483243.429159:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098770048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.429263:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098770048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.429270:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788483243.429289:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2e3f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788483243.429297:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.429322:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.429370:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483243.429388:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098770176 00000100:00100000:0.0:1788483243.429391:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098770176 00000100:00100000:0.0:1788483243.429410:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788483243.429416:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098770176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.429485:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098770176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483243.429492:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788483243.429519:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2e3f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788483243.429529:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788483243.438013:0:20312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788483243.439696:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788483243.439735:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483243.439749:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483243.439764:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483243.439776:0:17219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483243.439779:0:17219:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69ece13000 from 13 10000000:01000000:1.0:1788483243.439782:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483243.439827:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483243.439836:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483243.439849:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483243.439892:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483243.439985:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483243.440029:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3eae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788483243.440054:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098770304 00000100:00100000:1.0:1788483243.440060:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098770304 00000100:00100000:1.0:1788483243.440128:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788483243.440138:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:17219:x1875360098770304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483243.440153:0:17215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483243.440167:0:17215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1bc36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bc2f expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483243.441352:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1bc36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc2f expref: 24 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483243.441370:0:17215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1bc36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc2f expref: 24 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483243.441381:0:17215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a200, rc 0) 00000100:00100000:1.0:1788483243.441521:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098770304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1381us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483243.441530:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788483243.441753:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483243.441775:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483243.441785:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483243.441864:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483243.441895:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483243.441938:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2e3f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788483243.442170:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098770432 00000100:00100000:1.0:1788483243.442177:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098770432 00000100:00100000:1.0:1788483243.442568:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788483243.442578:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098770432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483243.442713:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098770432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483243.442727:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788483243.442761:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483243.442797:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483243.442837:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483243.442856:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3eae0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483243.442869:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098770560 00000100:00100000:1.0:1788483243.442872:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098770560 00000100:00100000:1.0:1788483243.442893:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788483243.442898:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098770560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483243.442984:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:17219:x1875360098770560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483243.442991:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788483243.443025:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4be19e4a-e21c-409c-93a6-e1423c5e2099:17219:1875360098770560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788483243.447659:0:20313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788483243.447903:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788483243.447948:0:17219:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483243.447962:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483243.447976:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483244.284349:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483244.284371:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098770688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483244.284433:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483244.284480:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098770688 00000100:00100000:0.0:1788483244.284498:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098770688 00000100:00100000:0.0:1788483244.284540:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483244.284549:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098770688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483244.284579:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483244.284621:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098770688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483244.284628:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483244.284673:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098770688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483244.288442:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098770816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483244.288507:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483244.288592:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098770816 00000100:00100000:0.0:1788483244.288600:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098770816 00000100:00100000:0.0:1788483244.288649:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483244.288660:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098770816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483244.288701:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788483244.288751:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098770816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483244.288758:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483244.288799:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098770816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483244.351771:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483245.197791:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.197839:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.197885:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.197929:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.197949:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.197967:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.197985:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.198003:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.198043:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.198307:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143552 00000100:00100000:0.0:1788483245.198330:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143552 00000100:00100000:0.0:1788483245.198385:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143680 00000100:00100000:0.0:1788483245.198389:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143680 00000100:00100000:0.0:1788483245.198404:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087144064 00000100:00100000:0.0:1788483245.198407:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087144064 00000100:00100000:0.0:1788483245.198421:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087144192 00000100:00100000:0.0:1788483245.198424:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087144192 00000100:00100000:0.0:1788483245.198441:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:0.0:1788483245.198451:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2392:x1875360087143552:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.198553:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2392:x1875360087143552:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 103us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.198561:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:0.0:1788483245.198580:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:0.0:1788483245.198588:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087143680:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.198615:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087143680:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 28us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.198621:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:0.0:1788483245.198634:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:0.0:1788483245.198640:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2392:x1875360087144064:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.198664:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2392:x1875360087144064:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.198684:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:0.0:1788483245.198696:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:0.0:1788483245.198704:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087144192:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.198729:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087144192:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.198735:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:0.0:1788483245.198755:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143808 00000100:00100000:0.0:1788483245.198758:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143808 00000100:00100000:0.0:1788483245.198782:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143936 00000100:00100000:0.0:1788483245.198785:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143936 00000100:00100000:0.0:1788483245.198798:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087144320 00000100:00100000:0.0:1788483245.198800:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087144320 00000100:00100000:0.0:1788483245.198812:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087144448 00000100:00100000:0.0:1788483245.198821:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087144448 00000100:00100000:0.0:1788483245.198840:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:0.0:1788483245.198847:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087143808:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.198888:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087143808:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 42us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.198905:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:0.0:1788483245.198919:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:0.0:1788483245.198925:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087143936:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.198950:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087143936:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.198956:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:0.0:1788483245.198968:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:0.0:1788483245.198974:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087144320:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.198997:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087144320:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.199003:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:0.0:1788483245.199014:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:0.0:1788483245.199021:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087144448:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483245.199042:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087144448:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 22us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.199048:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:1.0:1788483245.199822:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087143424 00000100:00100000:1.0:1788483245.199830:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087143424 00000100:00100000:1.0:1788483245.199892:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 166 00000100:00100000:1.0:1788483245.199910:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2393:x1875360087143424:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483245.199960:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2393:x1875360087143424:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 52us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483245.199968:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 166 00000100:00080000:2.0:1788483245.200791:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483245.200799:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483245.200802:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483245.200805:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788483245.368439:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483245.465901:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.465993:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087144576 00000100:00100000:0.0:1788483245.466002:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087144576 00000100:00100000:0.0:1788483245.466061:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:0.0:1788483245.466090:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:15598:x1875360087144576:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483245.466133:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483245.466155:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bc3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e707 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466217:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466230:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466243:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466257:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466265:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466271:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466360:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1bc52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466368:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1bc52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466376:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1bc52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483245.466410:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788483245.466413:0:17224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483245.466449:0:17224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1bc52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466460:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466467:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466473:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466479:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483245.466483:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466490:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466502:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:0.0:1788483245.466504:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.466508:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466514:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466525:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466542:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466548:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466552:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483245.466555:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466561:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466569:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a68c3603e00) 00010000:00010000:0.0:1788483245.466571:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.466574:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466579:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466609:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bc3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e707 expref: 8 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466623:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1bc52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e707 expref: 7 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.466630:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a68c3603a00) 00010000:00010000:0.0:1788483245.466633:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483245.466640:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9400, rc 0) 00000100:00100000:0.0:1788483245.466696:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+7:15598:x1875360087144576:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 607us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.466703:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:2.0:1788483245.470340:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483245.470490:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087144704 00000100:00100000:3.0:1788483245.470499:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087144704 00000100:00100000:3.0:1788483245.470555:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:3.0:1788483245.470565:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f66e931-3201-4238-a1e4-162d21e5f09a+7:15598:x1875360087144704:12345-192.168.206.54@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788483245.470651:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f66e931-3201-4238-a1e4-162d21e5f09a+7:15598:x1875360087144704:12345-192.168.206.54@tcp:900:lhsmtool_posix.0 Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483245.470658:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:0.0:1788483245.479294:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.479393:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087144960 00000100:00100000:2.0:1788483245.479413:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087144960 00000100:00100000:2.0:1788483245.479470:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:2.0:1788483245.479480:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+7:15598:x1875360087144960:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483245.479499:0:17222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483245.479522:0:17222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e70e expref: -99 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479588:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479603:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479614:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479628:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479635:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479641:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479751:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1bc6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479760:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479768:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483245.479778:0:17222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788483245.479926:0:17222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479936:0:17222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479943:0:17222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479950:0:17222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483245.479955:0:17222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479963:0:17222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.479975:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a68c3603a00) 00010000:00010000:2.0:1788483245.479978:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483245.479983:0:17222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480000:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bc60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480014:0:17222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480021:0:17222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480027:0:17222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480032:0:17222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483245.480036:0:17222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480042:0:17222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480050:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a69ecd6c200) 00010000:00010000:2.0:1788483245.480053:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483245.480056:0:17222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.480063:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bc67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.484836:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e70e expref: 10 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.485041:0:17222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1bc6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e70e expref: 9 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.485050:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69ecd6cd00) 00010000:00010000:2.0:1788483245.485053:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483245.485055:0:17222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77000, rc 0) 00000100:00100000:2.0:1788483245.485290:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15598:x1875360087144960:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 5810us (6004us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788483245.485299:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:3.0:1788483245.491318:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.491538:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087145088 00000100:00100000:0.0:1788483245.491547:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087145088 00000100:00100000:0.0:1788483245.491609:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:0.0:1788483245.491619:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15598:x1875360087145088:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788483245.491718:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15598:x1875360087145088:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 100us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.491725:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:3.0:1788483245.500859:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.500984:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087145216 00000100:00100000:0.0:1788483245.500992:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087145216 00000100:00100000:0.0:1788483245.501050:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:0.0:1788483245.501061:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15598:x1875360087145216:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788483245.518625:0:17223:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 17485us 00000100:00100000:3.0:1788483245.539446:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15598:x1875360087145216:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 38374us (38582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483245.539459:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:3.0:1788483245.552962:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.553277:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087145344 00000100:00100000:0.0:1788483245.553287:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087145344 00000100:00100000:0.0:1788483245.553371:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:0.0:1788483245.553383:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15604:x1875360087145344:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483245.553403:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483245.553423:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bc7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e715 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553494:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553522:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553532:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553547:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553554:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553561:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553596:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553603:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553610:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553616:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483245.553621:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553628:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553641:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:0.0:1788483245.553650:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.553656:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553662:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553674:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553681:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553687:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553692:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483245.553695:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553701:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553709:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a68c3603e00) 00010000:00010000:0.0:1788483245.553712:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.553715:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553721:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553751:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bc7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e715 expref: 10 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553768:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:0.0:1788483245.553771:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.553775:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bc7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e715 expref: 10 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.553785:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9000, rc 0) 00000100:00100000:0.0:1788483245.553844:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15604:x1875360087145344:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 464us (889us total) trans 0 rc 301/301 00000100:00100000:0.0:1788483245.553852:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:3.0:1788483245.561652:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483245.561751:0:17231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087145472 00000100:00100000:1.0:1788483245.561760:0:17231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087145472 00000100:00100000:1.0:1788483245.561804:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:1.0:1788483245.561812:0:17231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15604:x1875360087145472:12345-192.168.206.54@tcp:700:lfs.0 00000100:00100000:1.0:1788483245.561889:0:17231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15604:x1875360087145472:12345-192.168.206.54@tcp:700:lfs.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483245.561905:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:3.0:1788483245.563919:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.564024:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087145728 00000100:00100000:2.0:1788483245.564042:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087145728 00000100:00100000:2.0:1788483245.564128:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:2.0:1788483245.564139:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+9:15604:x1875360087145728:12345-192.168.206.54@tcp:36:lfs.0 00010000:00010000:2.0:1788483245.564190:0:17222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483245.564216:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1bbaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e682 expref: 9 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.564236:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:2.0:1788483245.564241:0:17222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483245.564301:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.564316:0:17222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 5 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.564324:0:17222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.564370:0:17222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 5 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.564383:0:17222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 5 pid: 18206 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483245.564397:0:17222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17222:1875360098770944:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483245.564471:0:17222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483245.568617:0:17222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17222:1875360098770944:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483245.568646:0:17222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483245.570063:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483245.570691:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087145856 00000100:00100000:1.0:1788483245.570701:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087145856 00010000:00010000:1.0:1788483245.570826:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 6 pid: 18206 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483245.570916:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:1.0:1788483245.570927:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2393:x1875360087145856:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483245.570943:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483245.570950:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 6 pid: 18206 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483245.570964:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 6 pid: 18206 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483245.570986:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1600/0x1d7ea3d89ea1bbe9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f2 expref: 6 pid: 18206 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483245.571030:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:1.0:1788483245.571035:0:17209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483245.571044:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483245.571051:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483245.571203:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483245.571254:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087145856:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 329us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483245.571262:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00010000:00010000:0.0:1788483245.573311:0:17222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.573328:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.573355:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.573368:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.573379:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582420:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582450:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582477:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483245.582500:0:17222:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011f1aa7d reply state 00000000ee713c2a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582513:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582522:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:0.0:1788483245.582525:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788483245.582531:0:17222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788483245.582538:0:17222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788483245.582549:0:17222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582555:0:17222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582561:0:17222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582567:0:17222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483245.582709:0:17222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582719:0:17222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582733:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69fd169900) 00010000:00010000:0.0:1788483245.582736:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.582747:0:17222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582754:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bc91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483245.582779:0:17222:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011f1aa7d reply state 00000000ee713c2a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582790:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.582797:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a68c3603e00) 00010000:00010000:0.0:1788483245.582800:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788483245.582803:0:17222:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788483245.586803:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+10:15604:x1875360087145728:12345-192.168.206.54@tcp:36:lfs.0 Request processed in 22648us (22875us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788483245.586818:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:3.0:1788483245.773354:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.773470:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087145984 00000100:00100000:2.0:1788483245.773481:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087145984 00000100:00100000:2.0:1788483245.773546:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:2.0:1788483245.773556:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+10:15612:x1875360087145984:12345-192.168.206.54@tcp:101:lctl.0 00010000:00010000:2.0:1788483245.773579:0:18206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483245.773602:0:18206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e71c expref: -99 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.773663:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bcad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.773678:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bcad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.773690:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bcad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483245.773743:0:18206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483245.773747:0:18206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483245.773783:0:18206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bcad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.773806:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e71c expref: 12 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.773824:0:18206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bcad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e71c expref: 11 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.773831:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:2.0:1788483245.773834:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483245.773838:0:18206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76200, rc 0) 00000100:00100000:2.0:1788483245.773916:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+11:15612:x1875360087145984:12345-192.168.206.54@tcp:101:lctl.0 Request processed in 361us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483245.773922:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:3.0:1788483245.799022:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.799356:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087146112 00000100:00100000:0.0:1788483245.799366:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087146112 00000100:00100000:0.0:1788483245.799441:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:0.0:1788483245.799452:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:15613:x1875360087146112:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483245.799472:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483245.799492:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e723 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.799551:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9200/0x1d7ea3d89ea1bcbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.799564:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9200/0x1d7ea3d89ea1bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.799591:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9200/0x1d7ea3d89ea1bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483245.799632:0:17223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788483245.799636:0:17223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483245.799654:0:17223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9200/0x1d7ea3d89ea1bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.799677:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e723 expref: 7 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.799695:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9200/0x1d7ea3d89ea1bcbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e723 expref: 6 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.799704:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:0.0:1788483245.799706:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483245.799710:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9200, rc 0) 00000100:00100000:0.0:1788483245.799773:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15613:x1875360087146112:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 323us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483245.799779:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:3.0:1788483245.803439:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.803616:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087146240 00000100:00100000:2.0:1788483245.803626:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087146240 00000100:00100000:2.0:1788483245.803680:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:2.0:1788483245.803689:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:15613:x1875360087146240:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483245.803707:0:18206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483245.803725:0:18206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e72a expref: -99 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803782:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803812:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803823:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803835:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803842:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803848:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803945:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bcd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803952:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.803959:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483245.803996:0:18206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483245.804000:0:18206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483245.804020:0:18206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804031:0:18206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804047:0:18206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804054:0:18206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804059:0:18206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483245.804063:0:18206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804071:0:18206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804082:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:2.0:1788483245.804085:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483245.804090:0:18206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804123:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bcc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804137:0:18206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804143:0:18206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804149:0:18206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804154:0:18206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483245.804163:0:18206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804169:0:18206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804176:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a68c3603e00) 00010000:00010000:2.0:1788483245.804178:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483245.804181:0:18206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804187:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bcd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804213:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e72a expref: 8 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804225:0:18206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bcd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e72a expref: 7 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.804232:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:2.0:1788483245.804234:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483245.804236:0:18206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77600, rc 0) 00000100:00100000:2.0:1788483245.804300:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+7:15613:x1875360087146240:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 612us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483245.804307:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:3.0:1788483245.808328:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483245.815995:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087146368 00000100:00100000:1.0:1788483245.816010:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087146368 00000100:00100000:1.0:1788483245.816078:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:1.0:1788483245.816088:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:15613:x1875360087146368:12345-192.168.206.54@tcp:900:lfs.0 00000100:00100000:1.0:1788483245.816592:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:15613:x1875360087146368:12345-192.168.206.54@tcp:900:lfs.0 Request processed in 504us (9336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483245.816601:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00000040:00080000:0.0:1788483245.817992:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788483245.829921:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.830367:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087146624 00000100:00100000:0.0:1788483245.830377:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087146624 00000100:00100000:0.0:1788483245.830437:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:0.0:1788483245.830449:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+7:15613:x1875360087146624:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483245.830468:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483245.830488:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e731 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483245.830600:0:17223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788483245.830708:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e731 expref: 9 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.830723:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:0.0:1788483245.830726:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483245.830731:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e731 expref: 9 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.830745:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9a00, rc 0) 00000100:00100000:0.0:1788483245.830805:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+8:15613:x1875360087146624:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 357us (892us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788483245.830812:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:3.0:1788483245.836704:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.836816:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087146880 00000100:00100000:2.0:1788483245.836837:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087146880 00000100:00100000:2.0:1788483245.836917:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:2.0:1788483245.836929:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+8:15613:x1875360087146880:12345-192.168.206.54@tcp:36:lfs.0 00010000:00010000:2.0:1788483245.837003:0:18206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483245.837032:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bcd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e72a expref: 8 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.837049:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:2.0:1788483245.837054:0:18206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483245.837075:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.837087:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.837147:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483245.837463:0:18206:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec4f186c reply state 000000009a5dec56 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.837476:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.837482:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:2.0:1788483245.837485:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788483245.837488:0:18206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788483245.837494:0:18206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788483245.837572:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+9:15613:x1875360087146880:12345-192.168.206.54@tcp:36:lfs.0 Request processed in 645us (876us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788483245.837580:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:3.0:1788483245.842548:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.842636:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087147136 00000100:00100000:2.0:1788483245.842645:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087147136 00000100:00100000:2.0:1788483245.842706:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:2.0:1788483245.842715:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+9:15613:x1875360087147136:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:2.0:1788483245.842928:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+10:15613:x1875360087147136:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 213us (388us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788483245.842936:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:3.0:1788483245.848515:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.850281:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087147392 00000100:00100000:0.0:1788483245.850294:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087147392 00000100:00100000:0.0:1788483245.850361:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:0.0:1788483245.850371:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+10:15613:x1875360087147392:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483245.850394:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483245.850414:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e738 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850481:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850494:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850517:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850543:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850551:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850559:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483245.850653:0:17223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788483245.850721:0:17223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850729:0:17223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850736:0:17223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850742:0:17223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483245.850746:0:17223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850753:0:17223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850765:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:0.0:1788483245.850768:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.850779:0:17223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850785:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9000/0x1d7ea3d89ea1bcfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850798:0:17223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850805:0:17223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850811:0:17223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850816:0:17223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483245.850819:0:17223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850824:0:17223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850832:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a68c3603e00) 00010000:00010000:0.0:1788483245.850834:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483245.850836:0:17223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850842:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850871:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e738 expref: 12 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850903:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:0.0:1788483245.850906:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483245.850910:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9a00/0x1d7ea3d89ea1bcf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e738 expref: 12 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483245.850921:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ed9d9a00, rc 0) 00000100:00100000:0.0:1788483245.850986:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+11:15613:x1875360087147392:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 616us (2480us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788483245.850993:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:3.0:1788483245.858438:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.858827:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087147520 00000100:00100000:2.0:1788483245.858837:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087147520 00000100:00100000:2.0:1788483245.858913:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:2.0:1788483245.858924:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+11:15613:x1875360087147520:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483245.858946:0:18206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483245.858968:0:18206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e73f expref: -99 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.859056:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.859070:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.859080:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483245.859143:0:18206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483245.859148:0:18206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483245.859166:0:18206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.859202:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 13 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.859238:0:18206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 12 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483245.859247:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:2.0:1788483245.859250:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483245.859506:0:18206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77800, rc 0) 00000100:00100000:2.0:1788483245.859569:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+12:15613:x1875360087147520:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 646us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483245.859576:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:3.0:1788483245.886919:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483245.887966:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087147648 00000100:00100000:2.0:1788483245.887977:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087147648 00000100:00100000:3.0:1788483245.892405:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:3.0:1788483245.892430:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+12:15613:x1875360087147648:12345-192.168.206.54@tcp:37:lfs.0 00000100:00100000:3.0:1788483245.907437:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+12:15613:x1875360087147648:12345-192.168.206.54@tcp:37:lfs.0 Request processed in 14997us (20502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483245.907450:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:1.0:1788483245.915696:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483245.915793:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087147904 00000100:00100000:0.0:1788483245.915802:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087147904 00000100:00100000:0.0:1788483245.915857:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:0.0:1788483245.915875:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c3844450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+12:15613:x1875360087147904:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:0.0:1788483245.916366:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c3844450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+13:15613:x1875360087147904:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 491us (676us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788483245.916375:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:2.0:1788483246.042080:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.042226:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087148032 00000100:00100000:0.0:1788483246.042235:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087148032 00000100:00100000:0.0:1788483246.042292:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:0.0:1788483246.042302:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+11:15619:x1875360087148032:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483246.042320:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.042342:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e746 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042401:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042434:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042446:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042458:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042466:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042473:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042542:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400c00/0x1d7ea3d89ea1bd32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042551:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400c00/0x1d7ea3d89ea1bd32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042557:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400c00/0x1d7ea3d89ea1bd32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483246.042588:0:17223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788483246.042592:0:17223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483246.042630:0:17223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400c00/0x1d7ea3d89ea1bd32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042641:0:17223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042657:0:17223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042679:0:17223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042685:0:17223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.042690:0:17223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042698:0:17223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042709:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:0.0:1788483246.042712:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483246.042716:0:17223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042722:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042743:0:17223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042749:0:17223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042755:0:17223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042760:0:17223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.042768:0:17223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042775:0:17223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042783:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a68c3603e00) 00010000:00010000:0.0:1788483246.042785:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483246.042788:0:17223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042794:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042819:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e746 expref: 13 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042831:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400c00/0x1d7ea3d89ea1bd32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e746 expref: 12 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.042839:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:0.0:1788483246.042841:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788483246.042843:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400c00, rc 0) 00000100:00100000:0.0:1788483246.045337:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+12:15619:x1875360087148032:12345-192.168.206.54@tcp:101:bash.0 Request processed in 3027us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.045348:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:1.0:1788483246.063887:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.063992:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087148160 00000100:00100000:2.0:1788483246.064002:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087148160 00000100:00100000:2.0:1788483246.064067:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:2.0:1788483246.064078:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15619:x1875360087148160:12345-192.168.206.54@tcp:900:bash.0 00000100:00100000:2.0:1788483246.064203:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15619:x1875360087148160:12345-192.168.206.54@tcp:900:bash.0 Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.064211:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483246.071409:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.071502:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087148416 00000100:00100000:2.0:1788483246.071511:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087148416 00000100:00100000:2.0:1788483246.071568:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:2.0:1788483246.071578:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+12:15619:x1875360087148416:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483246.071596:0:18206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483246.071616:0:18206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bd39 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e74d expref: -99 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.071741:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.071756:0:18206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 12 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.071765:0:18206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.071800:0:18206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 12 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.071815:0:18206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 12 pid: 18206 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483246.071829:0:18206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18206:1875360098771072:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483246.072141:0:18206:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2623180 going to sleep for 11 seconds 00000100:00100000:2.0:1788483246.081602:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.081747:0:18206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18206:1875360098771072:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483246.081771:0:18206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483246.083359:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087148544 00000100:00100000:3.0:1788483246.083374:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087148544 00010000:00010000:3.0:1788483246.083414:0:17208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 13 pid: 18206 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483246.084005:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:2.0:1788483246.084804:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+13:2393:x1875360087148544:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483246.084826:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483246.084836:0:17208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 13 pid: 18206 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.084852:0:17208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 13 pid: 18206 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.084981:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e73f expref: 13 pid: 18206 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.084998:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:2.0:1788483246.085003:0:17208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.085092:0:17208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.085243:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.085274:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483246.085337:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+12:2393:x1875360087148544:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 1014us (3741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.085346:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00010000:00010000:0.0:1788483246.085435:0:18206:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.085443:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.085466:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.085476:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.085484:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086741:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086754:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086763:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483246.086772:0:18206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788483246.086793:0:18206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086800:0:18206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086807:0:18206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086823:0:18206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.086827:0:18206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086834:0:18206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086844:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:0.0:1788483246.086846:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483246.086850:0:18206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.086856:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd40 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483246.089646:0:18206:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1391368 reply state 00000000e8023629 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.089663:0:18206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.089672:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a68c3603b00) 00010000:00010000:0.0:1788483246.089675:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788483246.089679:0:18206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788483246.089731:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bd39 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 15 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.089747:0:18206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 14 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.089776:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:0.0:1788483246.089779:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788483246.089782:0:18206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401a00, rc 0) 00000100:00100000:0.0:1788483246.089856:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+15:15619:x1875360087148416:12345-192.168.206.54@tcp:101:bash.0 Request processed in 18278us (18454us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788483246.094372:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:2.0:1788483246.106782:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.106877:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087148672 00000100:00100000:0.0:1788483246.106886:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087148672 00000100:00100000:0.0:1788483246.106951:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:0.0:1788483246.106962:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+15:15619:x1875360087148672:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:0.0:1788483246.106986:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.107006:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd5c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e754 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.107080:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.107092:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.107288:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483246.107332:0:17223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788483246.107336:0:17223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483246.107354:0:17223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.107380:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.107407:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd5c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 17 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.107423:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 16 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.107432:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:0.0:1788483246.107434:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483246.107438:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401c00, rc 0) 00000100:00100000:0.0:1788483246.107486:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+16:15619:x1875360087148672:12345-192.168.206.54@tcp:101:bash.0 Request processed in 526us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.107493:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:1.0:1788483246.111048:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483246.111267:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087148928 00000100:00100000:3.0:1788483246.111277:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087148928 00000100:00100000:3.0:1788483246.111332:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:3.0:1788483246.111343:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+16:15619:x1875360087148928:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:3.0:1788483246.111664:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+17:15619:x1875360087148928:12345-192.168.206.54@tcp:35:bash.0 Request processed in 322us (623us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788483246.111672:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:1.0:1788483246.289325:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.289434:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087149184 00000100:00100000:0.0:1788483246.289445:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087149184 00000100:00100000:0.0:1788483246.289509:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:0.0:1788483246.289520:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+17:15629:x1875360087149184:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483246.289543:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.289562:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e75b expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483246.289649:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788483246.289740:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e75b expref: 19 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.289771:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:0.0:1788483246.289773:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483246.289779:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e75b expref: 19 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.289791:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401000, rc 0) 00000100:00100000:0.0:1788483246.289846:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+18:15629:x1875360087149184:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 328us (529us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788483246.289853:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:2.0:1788483246.294923:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483246.295075:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087149440 00000100:00100000:3.0:1788483246.295084:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087149440 00000100:00100000:3.0:1788483246.295165:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:3.0:1788483246.295175:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+18:15629:x1875360087149440:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483246.295383:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+19:15629:x1875360087149440:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 209us (467us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788483246.295391:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:1.0:1788483246.382401:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.382521:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087149696 00000100:00100000:2.0:1788483246.382531:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087149696 00000100:00100000:2.0:1788483246.382591:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:2.0:1788483246.382601:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+19:15632:x1875360087149696:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483246.382624:0:17222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483246.382645:0:17222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e762 expref: -99 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.382775:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bd7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.382788:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bd7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.382798:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bd7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483246.382809:0:17222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788483246.382928:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e762 expref: 22 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.382946:0:17222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bd7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e762 expref: 21 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.382955:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483246.382958:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483246.382961:0:17222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76e00, rc 0) 00000100:00100000:2.0:1788483246.383167:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+21:15632:x1875360087149696:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 567us (774us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788483246.383174:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:1.0:1788483246.394199:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.394239:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.394261:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087149952 00000100:00100000:1.0:1788483246.394269:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087149952 00000100:00100000:1.0:1788483246.394322:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:1.0:1788483246.394331:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+21:2393:x1875360087149952:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483246.394345:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483246.394369:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bd7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e762 expref: 21 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.394386:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:1.0:1788483246.394391:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:0.0:1788483246.394510:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483246.394569:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+20:2393:x1875360087149952:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 237us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.394572:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087149824 00000100:00100000:0.0:1788483246.394579:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087149824 00000100:00100000:1.0:1788483246.394584:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:0.0:1788483246.394619:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:0.0:1788483246.394628:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+20:15632:x1875360087149824:12345-192.168.206.54@tcp:54:lfs.0 00010000:00010000:0.0:1788483246.394685:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394700:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394713:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394746:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394754:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394773:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394779:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.394784:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394791:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394800:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:0.0:1788483246.394803:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483246.394807:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.394813:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1bd8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483246.394867:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+20:15632:x1875360087149824:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 239us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.394874:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 41 00010000:00010000:0.0:1788483246.398200:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483246.409603:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483246.409672:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087150208 00000100:00100000:3.0:1788483246.409681:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087150208 00000100:00100000:3.0:1788483246.409733:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:3.0:1788483246.409743:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+20:15632:x1875360087150208:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483246.410993:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+21:15632:x1875360087150208:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 1245us (1392us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788483246.411004:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483246.679537:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.679613:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087150464 00000100:00100000:2.0:1788483246.679623:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087150464 00000100:00100000:2.0:1788483246.679686:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:2.0:1788483246.679696:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+21:15663:x1875360087150464:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:2.0:1788483246.679716:0:17222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483246.679754:0:17222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e769 expref: -99 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.679855:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.679869:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.679880:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483246.679901:0:17222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788483246.680027:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bd94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e769 expref: 24 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.680046:0:17222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e769 expref: 23 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.680055:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483246.680058:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483246.680061:0:17222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77600, rc 0) 00000100:00100000:2.0:1788483246.680373:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+23:15663:x1875360087150464:12345-192.168.206.54@tcp:101:cat.0 Request processed in 677us (844us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788483246.680381:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:1.0:1788483246.686153:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.686246:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087150592 00000100:00100000:2.0:1788483246.686256:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087150592 00000100:00100000:2.0:1788483246.686320:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:2.0:1788483246.686330:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+23:2393:x1875360087150592:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483246.686356:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483246.686381:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bd9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e769 expref: 23 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.686399:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483246.686403:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483246.686457:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+22:2393:x1875360087150592:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.686464:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:3.0:1788483246.686613:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.689541:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087150848 00000100:00100000:1.0:1788483246.689555:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087150848 00000100:00100000:1.0:1788483246.689625:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:1.0:1788483246.689635:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+22:15663:x1875360087150848:12345-192.168.206.54@tcp:35:cat.0 00000100:00100000:1.0:1788483246.689924:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+23:15663:x1875360087150848:12345-192.168.206.54@tcp:35:cat.0 Request processed in 289us (3310us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788483246.689933:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:3.0:1788483246.762950:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.763080:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087151104 00000100:00100000:1.0:1788483246.763090:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087151104 00000100:00100000:1.0:1788483246.763179:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:1.0:1788483246.763189:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+23:15670:x1875360087151104:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:1.0:1788483246.763213:0:18206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483246.763234:0:18206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1bda9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e770 expref: -99 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.763335:0:18206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.763350:0:18206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 24 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.763358:0:18206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 24 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.763365:0:18206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.763395:0:18206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 24 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.763408:0:18206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 24 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483246.763421:0:18206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18206:1875360098771200:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483246.763507:0:18206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 24 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.763525:0:18206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 24 pid: 18206 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483246.763534:0:18206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18206:1875360098771328:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483246.763557:0:18206:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c3eae540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483246.767331:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483246.767414:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087151232 00000100:00100000:3.0:1788483246.767423:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087151232 00010000:00010000:3.0:1788483246.767461:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 25 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483246.767500:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:3.0:1788483246.767510:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+25:2393:x1875360087151232:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483246.767524:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483246.767531:0:17207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 25 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483246.767543:0:17207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 25 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483246.767566:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:3.0:1788483246.767572:0:17207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483246.767581:0:17207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483246.767587:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483246.767647:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+25:2393:x1875360087151232:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 137us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.767654:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00010000:00010000:1.0:1788483246.768088:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401c00/0x1d7ea3d89ea1bd63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e754 expref: 24 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483246.768141:0:18206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18206:1875360098771200:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483246.770595:0:18206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18206:1875360098771328:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483246.770625:0:18206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483246.772628:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.772704:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087151360 00000100:00100000:1.0:1788483246.772714:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087151360 00010000:00010000:1.0:1788483246.772761:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 24 pid: 18206 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483246.772798:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:1.0:1788483246.772808:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+24:2393:x1875360087151360:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483246.772820:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483246.772826:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 24 pid: 18206 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.772840:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 24 pid: 18206 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.772879:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1bd4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e74d expref: 24 pid: 18206 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.772905:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:1.0:1788483246.772910:0:17209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.772919:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.772926:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.772956:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483246.773015:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+23:2393:x1875360087151360:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 202us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.773023:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00010000:00010000:2.0:1788483246.773121:0:18206:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.773129:0:18206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483246.773146:0:18206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788483246.773276:0:18206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ac00/0x1d7ea3d89ea1bda9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e770 expref: 24 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.773291:0:18206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e770 expref: 23 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.773299:0:18206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483246.773301:0:18206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483246.773304:0:18206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a600, rc 0) 00000100:00100000:2.0:1788483246.773340:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+23:15670:x1875360087151104:12345-192.168.206.54@tcp:101:dd.0 Request processed in 10153us (10400us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788483246.773355:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:2.0:1788483246.777506:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.777589:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087151488 00000100:00100000:0.0:1788483246.777597:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087151488 00000100:00100000:0.0:1788483246.777652:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:0.0:1788483246.777661:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+23:15670:x1875360087151488:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:0.0:1788483246.777681:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.777699:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bdbe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e777 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.777758:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.777769:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.777780:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.777897:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bdbe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 25 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.777915:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 24 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.777923:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:0.0:1788483246.777925:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483246.777929:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400800, rc 0) 00000100:00100000:0.0:1788483246.777987:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+24:15670:x1875360087151488:12345-192.168.206.54@tcp:101:dd.0 Request processed in 326us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.777993:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:0.0:1788483246.781703:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.781786:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087151744 00000100:00100000:2.0:1788483246.781796:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087151744 00000100:00100000:2.0:1788483246.781853:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:2.0:1788483246.781868:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+24:15670:x1875360087151744:12345-192.168.206.54@tcp:36:dd.0 00010000:00010000:2.0:1788483246.782076:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.782092:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.782140:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483246.782204:0:17224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788483246.782228:0:17224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070ac2da9 reply state 0000000075f318ba transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.782240:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.782247:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483246.782250:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483246.782254:0:17224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483246.782348:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+27:15670:x1875360087151744:12345-192.168.206.54@tcp:36:dd.0 Request processed in 486us (653us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788483246.782355:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 45 00000020:00080000:2.0:1788483246.782359:0:17224:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788483246.785671:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.785757:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087151872 00000100:00100000:0.0:1788483246.785766:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087151872 00000100:00100000:0.0:1788483246.785827:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:0.0:1788483246.785836:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+27:15670:x1875360087151872:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:0.0:1788483246.785859:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.785909:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400e00/0x1d7ea3d89ea1bdd3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e77e expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.785964:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400e00/0x1d7ea3d89ea1bdd3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e77e expref: 28 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.785978:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400e00/0x1d7ea3d89ea1bdd3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e77e expref: 28 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.785995:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:0.0:1788483246.785998:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483246.786002:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400e00, rc 0) 00000100:00100000:0.0:1788483246.786065:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15670:x1875360087151872:12345-192.168.206.54@tcp:101:dd.0 Request processed in 230us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.786072:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:3.0:1788483246.798580:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.798678:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087152128 00000100:00100000:2.0:1788483246.798686:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087152128 00000100:00100000:2.0:1788483246.798752:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:2.0:1788483246.798763:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15670:x1875360087152128:12345-192.168.206.54@tcp:103:dd.0 00010000:00010000:2.0:1788483246.798778:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483246.798802:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400e00/0x1d7ea3d89ea1bdd3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e77e expref: 28 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.798819:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483246.798824:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483246.798885:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+27:15670:x1875360087152128:12345-192.168.206.54@tcp:103:dd.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.798901:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:3.0:1788483246.801517:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.801613:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087152256 00000100:00100000:2.0:1788483246.801622:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087152256 00000100:00100000:2.0:1788483246.801678:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:2.0:1788483246.801688:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+27:15670:x1875360087152256:12345-192.168.206.54@tcp:58:dd.0 00010000:00010000:2.0:1788483246.801801:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.801817:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.801827:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483246.802879:0:17224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483246.803338:0:17224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788483246.803478:0:17224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788483246.803577:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+27:15670:x1875360087152256:12345-192.168.206.54@tcp:58:dd.0 Request processed in 1886us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.803587:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:3.0:1788483246.806214:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.806597:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087152384 00000100:00100000:0.0:1788483246.806606:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087152384 00000100:00100000:0.0:1788483246.806711:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 48 00000100:00100000:0.0:1788483246.806723:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+27:15670:x1875360087152384:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:0.0:1788483246.806752:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.806772:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e785 expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.806829:0:17223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.806839:0:17223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 28 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.806885:0:17223:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.806909:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 28 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.806922:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:0.0:1788483246.806924:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483246.806928:0:17223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 28 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.806936:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400200, rc 0) 00000100:00100000:0.0:1788483246.806989:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15670:x1875360087152384:12345-192.168.206.54@tcp:101:dd.0 Request processed in 269us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.806996:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 48 00000100:00100000:1.0:1788483246.840536:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098771584:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.840621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483246.840676:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098772096:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.840716:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483246.840738:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098772608:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.840762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483246.840795:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788483246.840800:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098771712:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.840823:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483246.840854:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098772224:0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.840964:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098771584 00000100:00100000:3.0:1788483246.840972:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098771584 00000100:00100000:3.0:1788483246.841028:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772096 00000100:00100000:3.0:1788483246.841031:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772096 00000100:00100000:3.0:1788483246.841050:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788483246.841057:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098771584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.841141:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098771584:12345-0@lo:400:kworker.0 Request processed in 84us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.841149:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788483246.841171:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788483246.841177:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098772096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.841205:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098772096:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.841210:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788483246.841262:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772608 00000100:00100000:3.0:1788483246.841269:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772608 00000100:00100000:3.0:1788483246.841312:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788483246.841322:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098772608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.841361:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098772608:12345-0@lo:400:kworker.0 Request processed in 40us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.841368:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788483246.841532:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483246.841552:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098772736:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841642:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4be19e4a-e21c-409c-93a6-e1423c5e2099:3622:1875360098771456:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841687:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483246.841722:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098771968:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841752:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483246.841769:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098772480:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841799:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483246.841813:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098772992:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841832:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483246.841847:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788483246.841852:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098771840:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841871:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483246.841884:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098772352:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841916:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483246.841934:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098772864:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.841963:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788483246.841983:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483246.842171:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483246.842382:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098771584:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842397:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098772096:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842407:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098772608:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842442:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098773120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483246.842467:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483246.842498:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098773120 00000100:00100000:1.0:1788483246.842502:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098773120 00000100:00100000:1.0:1788483246.842545:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483246.842552:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098773120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483246.842574:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788483246.842612:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098773120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.842618:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483246.842647:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098773120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483246.842679:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098771968 00000100:00100000:1.0:1788483246.842682:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098771968 00000100:00100000:1.0:1788483246.842698:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772480 00000100:00100000:1.0:1788483246.842700:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772480 00000100:00100000:1.0:1788483246.842710:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772992 00000100:00100000:1.0:1788483246.842712:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772992 00000100:00100000:1.0:1788483246.842723:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772864 00000100:00100000:1.0:1788483246.842725:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772864 00000100:00100000:1.0:1788483246.842748:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772736 00000100:00100000:1.0:1788483246.842751:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772736 00000100:00100000:1.0:1788483246.842764:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788483246.842770:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098771968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842803:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098771968:12345-0@lo:400:kworker.0 Request processed in 33us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.842809:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788483246.842818:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788483246.842823:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098772480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842844:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098772480:12345-0@lo:400:kworker.0 Request processed in 21us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.842849:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788483246.842870:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788483246.842877:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098772992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842910:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875360098772992:12345-0@lo:400:kworker.0 Request processed in 34us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.842915:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788483246.842925:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788483246.842930:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098772864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842951:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098772864:12345-0@lo:400:kworker.0 Request processed in 21us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.842956:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788483246.842965:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788483246.842970:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098772736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.842996:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098772736:12345-0@lo:400:kworker.0 Request processed in 26us (825us total) trans 0 rc 0/0 00000100:00080000:2.0:1788483246.843120:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483246.843123:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483246.843126:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483246.843158:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098772864:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.843168:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098771968:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.843178:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098772480:0@lo:400:kworker.0 00010000:00080000:2.0:1788483246.843198:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f5265f80 x1875360098772992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483246.843208:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098772992:0@lo:400:kworker.0 00010000:00080000:2.0:1788483246.843261:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f5264e00 x1875360098772736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483246.843269:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098772736:0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.844233:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098771712 00000100:00100000:3.0:1788483246.844241:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098771712 00000100:00100000:3.0:1788483246.844293:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772224 00000100:00100000:3.0:1788483246.844296:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772224 00000100:00100000:3.0:1788483246.844310:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098771840 00000100:00100000:3.0:1788483246.844313:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098771840 00000100:00100000:3.0:1788483246.844335:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098772352 00000100:00100000:3.0:1788483246.844337:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098772352 00000100:00100000:3.0:1788483246.844350:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788483246.844356:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098771712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.844411:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098771712:12345-0@lo:400:kworker.0 Request processed in 55us (3587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.844427:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788483246.844441:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788483246.844447:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098772224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.844477:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098772224:12345-0@lo:400:kworker.0 Request processed in 30us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.844482:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788483246.844493:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788483246.844499:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098771840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.844528:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098771840:12345-0@lo:400:kworker.0 Request processed in 30us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.844534:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788483246.844544:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788483246.844550:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098772352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483246.844575:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098772352:12345-0@lo:400:kworker.0 Request processed in 26us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.844580:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483246.844768:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098771456 00000100:00100000:0.0:1788483246.844773:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098771456 00000100:00100000:0.0:1788483246.844801:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788483246.844807:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3622:x1875360098771456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483246.844836:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3622:x1875360098771456:12345-0@lo:400:kworker.0 Request processed in 29us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.844841:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000040:00080000:0.0:1788483246.844984:0:17258:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788483246.844989:0:17258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483246.845032:0:17258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788483246.845038:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788483246.845161:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c1ca7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17258:1875360098773248:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788483246.845226:0:17258:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1c45540 going to sleep for 11 seconds 00000100:00080000:2.0:1788483246.845538:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483246.845543:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483246.845571:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098771840:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.845584:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098772352:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.845593:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4be19e4a-e21c-409c-93a6-e1423c5e2099:3622:1875360098771456:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.845630:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098771712:0@lo:400:kworker.0 00000100:00100000:2.0:1788483246.845640:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098772224:0@lo:400:kworker.0 00000100:00100000:1.0:1788483246.848148:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788483246.851002:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098773376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483246.851072:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483246.851185:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098773376 00000100:00100000:3.0:1788483246.851194:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098773376 00000100:00100000:3.0:1788483246.851239:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788483246.851248:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098773376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483246.851285:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788483246.851330:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098773376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483246.851337:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788483246.851591:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c1ca7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17258:1875360098773248:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788483246.851786:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098773376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483246.856845:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.857129:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087152512 00000100:00100000:2.0:1788483246.857138:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087152512 00000100:00100000:2.0:1788483246.857190:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00100000:2.0:1788483246.857199:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15671:x1875360087152512:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788483246.857232:0:17224:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788483246.857354:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15671:x1875360087152512:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 156us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.857362:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00100000:0.0:1788483246.860539:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.860630:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087152640 00000100:00100000:2.0:1788483246.860647:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087152640 00000100:00100000:2.0:1788483246.860696:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:2.0:1788483246.860705:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15671:x1875360087152640:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788483246.860772:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860787:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860798:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860810:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860817:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860823:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860842:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860850:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860864:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483246.860913:0:17223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788483246.860917:0:17223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483246.860934:0:17223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860944:0:17223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860951:0:17223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860958:0:17223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860964:0:17223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483246.860968:0:17223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860975:0:17223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860984:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69ecd6cd00) 00010000:00010000:2.0:1788483246.860987:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483246.860991:0:17223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.860996:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76e00/0x1d7ea3d89ea1bde8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861007:0:17223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861022:0:17223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861028:0:17223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861039:0:17223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483246.861043:0:17223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861049:0:17223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861056:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a69ecd6c000) 00010000:00010000:2.0:1788483246.861058:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483246.861061:0:17223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861067:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1bdef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861079:0:17223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861085:0:17223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861092:0:17223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861359:0:17223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483246.861362:0:17223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861368:0:17223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861387:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483246.861390:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483246.861392:0:17223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.861397:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1bdf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483246.861473:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15671:x1875360087152640:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 Request processed in 768us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.861480:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:0.0:1788483246.867869:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.867981:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087152896 00000100:00100000:1.0:1788483246.867991:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087152896 00000100:00100000:1.0:1788483246.868051:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:1.0:1788483246.868061:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+28:15671:x1875360087152896:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483246.868080:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483246.868127:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1bdfd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e78c expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868223:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868238:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868249:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483246.868260:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788483246.868335:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868343:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868350:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868369:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8aa00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483246.868373:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868381:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868393:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:1.0:1788483246.868396:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788483246.868400:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868405:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868446:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1bdfd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e78c expref: 30 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868456:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69ecd6cd00) 00010000:00010000:1.0:1788483246.868459:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788483246.868462:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1bdfd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e78c expref: 30 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.868472:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8ba00, rc 0) 00000100:00100000:1.0:1788483246.868522:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+29:15671:x1875360087152896:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 463us (663us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788483246.868530:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:0.0:1788483246.874815:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.874904:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087153024 00000100:00100000:1.0:1788483246.874925:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087153024 00000100:00100000:1.0:1788483246.874989:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:1.0:1788483246.874998:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+29:15671:x1875360087153024:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483246.875033:0:17222:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788483246.875175:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c5419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+29:15671:x1875360087153024:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 177us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.875182:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:0.0:1788483246.887917:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.888018:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087153280 00000100:00100000:1.0:1788483246.888027:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087153280 00000100:00100000:1.0:1788483246.888084:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:1.0:1788483246.888127:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+29:15671:x1875360087153280:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483246.888146:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483246.888167:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be12 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e793 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483246.888521:0:17224:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:1.0:1788483246.888529:0:17224:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788483246.888545:0:17224:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788483246.888676:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.888690:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.888702:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.888751:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be12 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e793 expref: 32 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.888787:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e793 expref: 31 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.888796:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169d00) 00010000:00010000:1.0:1788483246.888799:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483246.888803:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8aa00, rc 0) 00000100:00100000:1.0:1788483246.888851:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+31:15671:x1875360087153280:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 759us (942us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788483246.888859:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:3.0:1788483246.898804:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.898914:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087153536 00000100:00100000:1.0:1788483246.898924:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087153536 00000100:00100000:1.0:1788483246.898980:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:1.0:1788483246.898989:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+31:15671:x1875360087153536:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483246.899050:0:17222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483246.899077:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e793 expref: 31 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899140:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169d00) 00010000:00010000:1.0:1788483246.899151:0:17222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483246.899171:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899183:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899192:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899218:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899225:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899231:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899275:0:17222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899281:0:17222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899287:0:17222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899292:0:17222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8ba00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483246.899296:0:17222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899303:0:17222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899311:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:1.0:1788483246.899314:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483246.899317:0:17222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899323:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8ba00/0x1d7ea3d89ea1be27 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899340:0:17222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899345:0:17222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899351:0:17222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899356:0:17222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483246.899359:0:17222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899365:0:17222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899373:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3e758ba7 (ffff9a69fd169800) 00010000:00010000:1.0:1788483246.899375:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483246.899378:0:17222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.899383:0:17222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e758ba7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483246.899464:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+30:15671:x1875360087153536:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 475us (670us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788483246.899472:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:0.0:1788483246.903144:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.903230:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087153664 00000100:00100000:1.0:1788483246.903240:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087153664 00000100:00100000:1.0:1788483246.903292:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:1.0:1788483246.903315:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+30:15671:x1875360087153664:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483246.903334:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483246.903354:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be35 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e79a expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.903386:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1be3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.903398:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1be3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.903409:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1be3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.903509:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e79a expref: 32 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.903527:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1be3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e79a expref: 31 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.903535:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:1.0:1788483246.903537:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483246.903541:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a000, rc 0) 00000100:00100000:1.0:1788483246.903589:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+31:15671:x1875360087153664:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 278us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.903596:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:3.0:1788483246.913488:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.913594:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087153920 00000100:00100000:1.0:1788483246.913603:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087153920 00000100:00100000:1.0:1788483246.913662:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:1.0:1788483246.913687:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+31:15671:x1875360087153920:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483246.913765:0:17222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.913782:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.913793:0:17222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483246.913966:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788483246.913975:0:17222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 539176878509ns, next at 540176875852ns, rc = 0 00000004:00010000:1.0:1788483246.914036:0:17222:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000228ccf2f reply state 00000000e5b2f812 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.914047:0:17222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.914055:0:17222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:1.0:1788483246.914057:0:17222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788483246.914061:0:17222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483246.914293:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+33:15671:x1875360087153920:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 607us (813us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788483246.914301:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:0.0:1788483246.924211:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.924307:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087154048 00000100:00100000:1.0:1788483246.924316:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087154048 00000100:00100000:1.0:1788483246.924372:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:1.0:1788483246.924382:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+33:15671:x1875360087154048:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483246.924404:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483246.924437:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e7a1 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.924492:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 34 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.924507:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 34 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.924525:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:1.0:1788483246.924528:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483246.924531:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b400, rc 0) 00000100:00100000:1.0:1788483246.924593:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+34:15671:x1875360087154048:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 212us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.924600:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:0.0:1788483246.935574:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483246.935649:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087154176 00000100:00100000:3.0:1788483246.935658:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087154176 00000100:00100000:3.0:1788483246.935711:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:3.0:1788483246.935721:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087154176:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788483246.936185:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2392:x1875360087154176:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 464us (619us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788483246.936195:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:0.0:1788483246.944662:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.944773:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087154432 00000100:00100000:1.0:1788483246.944782:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087154432 00000100:00100000:1.0:1788483246.944877:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:1.0:1788483246.944897:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+34:15671:x1875360087154432:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788483246.945221:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+35:15671:x1875360087154432:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 334us (567us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788483246.945230:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:1.0:1788483246.947765:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.947841:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087154688 00000100:00100000:0.0:1788483246.947851:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087154688 00000100:00100000:0.0:1788483246.947922:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:0.0:1788483246.947933:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+35:15671:x1875360087154688:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483246.948220:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+35:15671:x1875360087154688:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 289us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.948228:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:0.0:1788483246.951201:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.951277:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087154816 00000100:00100000:1.0:1788483246.951285:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087154816 00000100:00100000:1.0:1788483246.951338:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:1.0:1788483246.951348:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+35:15671:x1875360087154816:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483246.951379:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483246.951399:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e7a8 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.951463:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1be58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.951478:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1be58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.951488:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1be58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483246.951529:0:17224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483246.951548:0:17224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1be58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.951574:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8aa00/0x1d7ea3d89ea1be51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a8 expref: 37 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.951591:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1be58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a8 expref: 36 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483246.951600:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:1.0:1788483246.951603:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788483246.951606:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b200, rc 0) 00000100:00100000:1.0:1788483246.951666:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+36:15671:x1875360087154816:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 320us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.951674:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:3.0:1788483246.954410:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.954610:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087154944 00000100:00100000:0.0:1788483246.954619:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087154944 00000100:00100000:0.0:1788483246.954675:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:0.0:1788483246.954685:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f66e931-3201-4238-a1e4-162d21e5f09a+6:2393:x1875360087154944:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483246.954702:0:20063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.954723:0:20063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e7af expref: -99 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483246.954757:0:20063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a16ae, blocks: 0x0 00010000:00010000:0.0:1788483246.954785:0:20063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788483246.954790:0:20063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483246.954799:0:20063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 7 pid: 20063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.954817:0:20063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 7 pid: 20063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.954831:0:20063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400400, rc 0) 00000100:00100000:0.0:1788483246.955074:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2393:x1875360087154944:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 389us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.955081:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:0.0:1788483246.958711:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483246.958839:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087155200 00000100:00100000:1.0:1788483246.958849:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087155200 00000100:00100000:1.0:1788483246.959015:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:1.0:1788483246.959026:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+36:15671:x1875360087155200:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788483246.959254:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+36:15671:x1875360087155200:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 229us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483246.959262:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:0.0:1788483246.961883:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.961968:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087155328 00000100:00100000:2.0:1788483246.961977:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087155328 00000100:00100000:2.0:1788483246.962040:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:2.0:1788483246.962050:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+36:15671:x1875360087155328:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788483246.964598:0:17202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788483246.964615:0:17202:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788483246.964662:0:17202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788483246.964715:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.964802:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.964811:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.964817:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.964822:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.964839:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.964867:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:0.0:1788483246.964870:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788483246.964875:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.964882:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1bcec lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483246.965037:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483246.965052:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098773504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788483246.965134:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483246.965258:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+19:15671:x1875360087155328:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 Request processed in 3207us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483246.965267:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:0.0:1788483246.965617:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098773504 00000100:00100000:0.0:1788483246.965625:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098773504 00000100:00100000:0.0:1788483246.965667:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483246.965676:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098773504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788483246.965938:0:18730:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788483246.965943:0:18730:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788483246.965945:0:18730:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788483246.965947:0:18730:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788483246 -> 1788483246 00002000:00010000:0.0:1788483246.965949:0:18730:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788483246.965990:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098773504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 315us (857us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788483246.965997:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1788483246.967259:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69efde9f80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788483246.967270:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098773504:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788483246.970779:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970797:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970822:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970829:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.970834:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970842:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970869:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a68c3603e00) 00010000:00010000:0.0:1788483246.970872:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483246.970877:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970884:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8200/0x1d7ea3d89ea1bc98 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970914:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970920:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970927:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970932:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d8e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.970935:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970951:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970960:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:0.0:1788483246.970962:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483246.970965:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970971:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d8e00/0x1d7ea3d89ea1bc9f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970984:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970991:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.970997:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971003:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.971016:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971023:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971030:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a68c3603b00) 00010000:00010000:0.0:1788483246.971033:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483246.971035:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971048:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1bd47 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971063:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971069:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971074:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971079:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.971081:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971087:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971122:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:0.0:1788483246.971125:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483246.971129:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971135:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1bdcc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971145:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971151:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971163:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971168:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483246.971171:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971177:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971186:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:0.0:1788483246.971188:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788483246.971191:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.971197:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b000/0x1d7ea3d89ea1be43 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483246.973391:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.973518:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087155456 00000100:00100000:0.0:1788483246.973528:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087155456 00000100:00100000:0.0:1788483246.973582:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:0.0:1788483246.973592:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2392:x1875360087155456:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788483246.973691:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2392:x1875360087155456:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483246.973698:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:0.0:1788483246.981682:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483246.981779:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087155712 00000100:00100000:2.0:1788483246.981789:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087155712 00000100:00100000:2.0:1788483246.981843:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:2.0:1788483246.981853:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+15:15671:x1875360087155712:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483246.981933:0:17223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483246.981959:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b200/0x1d7ea3d89ea1be58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a8 expref: 15 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.981976:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:2.0:1788483246.981981:0:17223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483246.982018:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.982032:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.982041:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483246.982191:0:17223:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066a08648 reply state 00000000f6c402ca transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.982202:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483246.982209:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:2.0:1788483246.982211:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483246.982214:0:17223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483246.982293:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+16:15671:x1875360087155712:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 441us (620us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788483246.982301:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:1.0:1788483246.992804:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483246.993124:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087155840 00000100:00100000:0.0:1788483246.993133:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087155840 00000100:00100000:0.0:1788483246.993212:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:0.0:1788483246.993221:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f66e931-3201-4238-a1e4-162d21e5f09a+7:15671:x1875360087155840:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483246.993238:0:20063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483246.993255:0:20063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e7b6 expref: -99 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.993287:0:20063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 8 pid: 20063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.993296:0:20063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483246.993301:0:20063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483246.993307:0:20063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 8 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.993342:0:20063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 8 pid: 20063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483246.993356:0:20063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 8 pid: 20063 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483246.993370:0:20063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20063:1875360098773632:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483246.993445:0:20063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1c45540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483247.000635:0:20063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20063:1875360098773632:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483247.000671:0:20063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 8 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.000704:0:20063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401e00, rc 0) 00000100:00100000:2.0:1788483247.000765:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f66e931-3201-4238-a1e4-162d21e5f09a+8:15671:x1875360087155840:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 7544us (7968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483247.000774:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:1.0:1788483247.009264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483247.009354:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087155968 00000100:00100000:3.0:1788483247.009364:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087155968 00010000:00010000:3.0:1788483247.009418:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 8 pid: 20063 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483247.009460:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:3.0:1788483247.009470:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+8:2393:x1875360087155968:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483247.009485:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483247.009513:0:17207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 8 pid: 20063 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.009527:0:17207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 8 pid: 20063 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.009549:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1be5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7af expref: 8 pid: 20063 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.009565:0:17207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483247.009570:0:17207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483247.009578:0:17207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 7 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.009589:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 7 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.009626:0:17207:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 7 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483247.009640:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6232300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17207:1875360098773760:192.168.206.54@tcp:105: 00000100:00100000:3.0:1788483247.009719:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9840 going to sleep for 11 seconds 00000100:00080000:2.0:1788483247.009928:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483247.013247:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6232300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17207:1875360098773760:192.168.206.54@tcp:105: 00010000:00010000:3.0:1788483247.013273:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483247.013333:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2393:x1875360087155968:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 3863us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483247.013359:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:0.0:1788483247.015277:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483247.015358:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087156096 00000100:00100000:2.0:1788483247.015367:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087156096 00000100:00100000:2.0:1788483247.015414:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:2.0:1788483247.015423:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2392:x1875360087156096:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788483247.015556:0:18729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788483247.015560:0:18729:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788483246 00002000:00010000:2.0:1788483247.015563:0:18729:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788483245 00002000:00010000:2.0:1788483247.015565:0:18729:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788483246 -> 1788483246 00002000:00010000:2.0:1788483247.015567:0:18729:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788483247.015624:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+8:2392:x1875360087156096:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 202us (353us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788483247.015632:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:1.0:1788483247.018901:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483247.018990:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087156224 00000100:00100000:2.0:1788483247.019000:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087156224 00000100:00100000:2.0:1788483247.019057:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:2.0:1788483247.019067:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+8:2390:x1875360087156224:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788483247.019141:0:19165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.019179:0:19165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 8 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.019188:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483247.019192:0:19165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483247.019197:0:19165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.019231:0:19165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 8 pid: 20063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.019245:0:19165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 8 pid: 20063 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.019259:0:19165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19165:1875360098773888:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483247.019336:0:19165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26239c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483247.023052:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483247.023182:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087156352 00000100:00100000:3.0:1788483247.023191:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087156352 00010000:00010000:3.0:1788483247.023229:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 9 pid: 20063 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483247.023270:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788483247.023279:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+9:2393:x1875360087156352:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483247.023292:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483247.023312:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 9 pid: 20063 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.023325:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 9 pid: 20063 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.023347:0:17209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483247.023352:0:17209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483247.023357:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.023366:0:17209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.023384:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483247.023435:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+9:2393:x1875360087156352:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 156us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483247.023457:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00010000:00010000:2.0:1788483247.024480:0:19165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1be6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7b6 expref: 8 pid: 20063 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.024499:0:19165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19165:1875360098773888:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483247.024520:0:19165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024530:0:19165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024547:0:19165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024568:0:19165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024576:0:19165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024584:0:19165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024591:0:19165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483247.024595:0:19165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024604:0:19165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024618:0:19165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.024626:0:19165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1be74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.024707:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2390:x1875360087156224:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 Request processed in 5640us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483247.024715:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:1.0:1788483247.027686:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483247.027762:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087156608 00000100:00100000:2.0:1788483247.027770:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087156608 00000100:00100000:2.0:1788483247.027833:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:2.0:1788483247.027843:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+16:15671:x1875360087156608:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788483247.027929:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.027946:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 16 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.027955:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.027986:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 16 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.027999:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 16 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.028022:0:17224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17224:1875360098774016:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483247.028115:0:17224:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c26239c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788483247.028871:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483247.034950:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483247.035047:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087156736 00000100:00100000:1.0:1788483247.035055:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087156736 00010000:00010000:1.0:1788483247.035093:0:17207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 17 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483247.035166:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:1.0:1788483247.035176:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+17:2393:x1875360087156736:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483247.035191:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483247.035198:0:17207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 17 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.035211:0:17207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 17 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.035233:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:1.0:1788483247.035252:0:17207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 17 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.035262:0:17207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.035270:0:17207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.035277:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.035294:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483247.035338:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+17:2393:x1875360087156736:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 163us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483247.035346:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00010000:00010000:2.0:1788483247.035444:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1bdc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e777 expref: 16 pid: 17223 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.035476:0:17224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17224:1875360098774016:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483247.035496:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.035505:0:17224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.035511:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.035689:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.035701:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 16 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.035710:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.035734:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 16 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.035747:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 16 pid: 17224 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.035760:0:17224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17224:1875360098774144:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483247.035809:0:17224:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2623d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483247.039588:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483247.039676:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087156864 00000100:00100000:1.0:1788483247.039685:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087156864 00010000:00010000:1.0:1788483247.039740:0:17208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 17 pid: 17224 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483247.039779:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:1.0:1788483247.039788:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+17:2392:x1875360087156864:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483247.039804:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483247.039812:0:17208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 17 pid: 17224 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.039825:0:17208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 17 pid: 17224 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.039875:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:1.0:1788483247.039880:0:17208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.039900:0:17208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.039908:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483247.039925:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483247.039982:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+17:2392:x1875360087156864:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 194us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483247.039990:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00010000:00010000:2.0:1788483247.040506:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8b400/0x1d7ea3d89ea1be4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7a1 expref: 16 pid: 17224 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.040522:0:17224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17224:1875360098774144:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483247.040541:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.040549:0:17224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.040555:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483247.040640:0:17224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788483247.040728:0:17224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788483247.040753:0:17224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788483247.040810:0:17224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17224:1875360098774272:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788483247.040850:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483247.040881:0:17224:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2623300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483247.040981:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098774272 00000100:00100000:0.0:1788483247.040986:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098774272 00000100:00100000:0.0:1788483247.041031:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788483247.041038:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17224:x1875360098774272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788483247.041122:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17224:x1875360098774272:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483247.041129:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788483247.041777:0:17224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17224:1875360098774272:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788483247.041939:0:17224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788483247.041985:0:17224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17224:1875360098774400:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788483247.042026:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483247.042047:0:17224:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2623b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483247.042204:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098774400 00000100:00100000:3.0:1788483247.042209:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098774400 00000100:00100000:3.0:1788483247.042234:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788483247.042240:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17224:x1875360098774400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788483247.042351:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17224:x1875360098774400:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (324us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788483247.042358:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788483247.042421:0:17224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17224:1875360098774400:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788483247.042452:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042461:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042473:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042479:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483247.042483:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042490:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042504:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:2.0:1788483247.042507:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483247.042510:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042517:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be82 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042542:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042547:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042553:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042559:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483247.042561:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042575:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042582:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483247.042584:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483247.042590:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 19 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042601:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 19 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042610:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 19 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.042652:0:17224:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 19 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.042662:0:17224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17224:1875360098774528:192.168.206.54@tcp:105: 00000100:00100000:2.0:1788483247.042720:0:17224:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63de180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483247.049829:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483247.049978:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087156992 00000100:00100000:0.0:1788483247.049987:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087156992 00000100:00100000:0.0:1788483247.050052:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:0.0:1788483247.050062:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c3846850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+20:15670:x1875360087156992:12345-192.168.206.54@tcp:49:dd.0 00000100:00100000:0.0:1788483247.050207:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c3846850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+20:15670:x1875360087156992:12345-192.168.206.54@tcp:49:dd.0 Request processed in 147us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483247.050214:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:2.0:1788483247.050392:0:17224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17224:1875360098774528:192.168.206.54@tcp:105: 00010000:00010000:2.0:1788483247.050414:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050424:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1bdda lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050453:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050478:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050487:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050497:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050502:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050508:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050512:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483247.050516:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050522:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050531:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483247.050534:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483247.050537:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050542:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1be89 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050551:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050561:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050566:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050571:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483247.050573:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050578:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050587:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483247.050589:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483247.050592:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.050597:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1be7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.050715:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+19:15671:x1875360087156608:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 22873us (23038us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788483247.050723:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 63 00000020:00080000:2.0:1788483247.050739:0:17224:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788483247.050876:0:17258:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788483247.050881:0:17258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483247.050909:0:17258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788483247.050916:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788483247.055694:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483247.055877:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483247.056020:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087157248 00000100:00100000:0.0:1788483247.056029:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087157248 00000100:00100000:0.0:1788483247.056079:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:0.0:1788483247.056088:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+19:15671:x1875360087157248:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788483247.056491:0:17226:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788483247.056521:0:17226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788483247.056556:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483247.056572:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483247.056582:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483247.056591:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483247.056610:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483247.056616:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483247.056643:0:17226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483247.056783:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483247.056791:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.056797:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483247.056802:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.056809:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.056821:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:3.0:1788483247.056823:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788483247.056828:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.056833:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1be90 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.056866:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483247.056869:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483247.056870:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483247.057162:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+21:15671:x1875360087157248:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 1072us (1474us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788483247.057172:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000020:00080000:0.0:1788483247.057177:0:17226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788483247.057285:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087157376 00000100:00100000:2.0:1788483247.057291:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087157376 00000100:00100000:2.0:1788483247.057332:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:2.0:1788483247.057340:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+21:15670:x1875360087157376:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:2.0:1788483247.057359:0:17223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483247.057373:0:17223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be97 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e7bd expref: -99 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.057402:0:17223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1be9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.057411:0:17223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1be9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.057420:0:17223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1be9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.057503:0:17223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27e00/0x1d7ea3d89ea1be97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7bd expref: 23 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.057519:0:17223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1be9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7bd expref: 22 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.057526:0:17223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483247.057529:0:17223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483247.057531:0:17223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27a00, rc 0) 00000100:00100000:2.0:1788483247.057688:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+22:15670:x1875360087157376:12345-192.168.206.54@tcp:101:dd.0 Request processed in 349us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483247.057695:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:1.0:1788483247.250914:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483247.251018:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087157504 00000100:00100000:3.0:1788483247.251027:0:18734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087157504 00000100:00100000:3.0:1788483247.251121:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:3.0:1788483247.251142:0:18734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2392:x1875360087157504:12345-192.168.206.54@tcp:4:dd.0 00002000:00010000:3.0:1788483247.251185:0:18734:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9a16ae, atime: 0x6a9a16ad, ctime: 0x6a9a16ae, blocks: 0x0 00010000:00010000:3.0:1788483247.251194:0:18734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.251209:0:18734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788483247.251213:0:18734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483247.251218:0:18734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483247.251231:0:18734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483247.257334:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483247.257512:0:18736:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788483247.257521:0:18736:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788483247.259409:0:18736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087157632 00000100:00100000:0.0:1788483247.259420:0:18736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087157632 00000100:00100000:2.0:1788483247.260409:0:20363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:2.0:1788483247.260423:0:20363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+9:2392:x1875360087157632:12345-192.168.206.54@tcp:4:dd.0 00010000:00010000:2.0:1788483247.260464:0:20363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.260482:0:20363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483247.260486:0:20363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483247.260492:0:20363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.260507:0:20363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483247.376391:0:19542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788483247.376405:0:19542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788483247.377777:0:18734:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788483247.377786:0:18734:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788483247.377803:0:18734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.377815:0:18734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.377824:0:18734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.377831:0:18734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483247.377835:0:18734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.377843:0:18734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.377877:0:18734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.377895:0:18734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1bea5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.385537:0:18734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+7:2392:x1875360087157504:12345-192.168.206.54@tcp:4:dd.0 Request processed in 134385us (134620us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788483247.385551:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00010000:00010000:3.0:1788483247.417262:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788483247.423637:0:19542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788483247.424187:0:20363:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788483247.424193:0:20363:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788483247.424209:0:20363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.424222:0:20363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.424231:0:20363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.424238:0:20363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483247.424243:0:20363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.424251:0:20363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.424282:0:20363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483247.424290:0:20363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c57a59f/0x1d7ea3d89ea1beac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483247.424439:0:20363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087157632:12345-192.168.206.54@tcp:4:dd.0 Request processed in 164015us (167110us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788483247.424448:0:20363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:2.0:1788483248.376304:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098774656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483248.376372:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483248.376463:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098774656 00000100:00100000:1.0:1788483248.376470:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098774656 00000100:00100000:1.0:1788483248.376536:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788483248.376546:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098774656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788483248.376571:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788483248.376956:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483248.377068:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483248.377081:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098774784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483248.377136:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483248.377162:0:18733:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788483248.377170:0:18733:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788483248.377316:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098774784 00000100:00100000:0.0:1788483248.377321:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098774784 00000100:00080000:0.0:1788483248.377349:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483248.377421:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483248.377429:0:20364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098774784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483248.377442:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483248.377474:0:20364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098774784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483248.377490:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483248.377542:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098774784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483248.384611:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098774656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8056us (8228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483248.384643:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788483248.389031:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098774656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788483248.440569:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483249.410048:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098774912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483249.410151:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483249.410207:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098775040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483249.410238:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483249.410270:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098774912 00000100:00100000:1.0:1788483249.410276:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098774912 00000100:00100000:1.0:1788483249.410313:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775040 00000100:00100000:1.0:1788483249.410316:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775040 00000100:00100000:1.0:1788483249.410333:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788483249.410340:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098774912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483249.410373:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788483249.410414:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098774912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483249.410421:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788483249.410437:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788483249.410443:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098775040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483249.410460:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788483249.410495:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098775040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483249.410501:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788483249.410541:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098775040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483249.410567:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098774912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788483249.464245:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788483249.534510:0:20401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788483250.321091:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.321175:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.321215:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.321246:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.321264:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.321282:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483250.321436:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087157760 00000100:00100000:1.0:1788483250.321446:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087157760 00000100:00100000:1.0:1788483250.321494:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 168 00000100:00100000:1.0:1788483250.321503:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2392:x1875360087157760:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483250.321567:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2392:x1875360087157760:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 65us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483250.321574:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 168 00000100:00100000:2.0:1788483250.321813:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158016 00000100:00100000:2.0:1788483250.321819:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158016 00000100:00100000:2.0:1788483250.321877:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158528 00000100:00100000:2.0:1788483250.321882:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158528 00000100:00100000:2.0:1788483250.321897:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087157888 00000100:00100000:2.0:1788483250.321900:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087157888 00000100:00100000:2.0:1788483250.321916:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:2.0:1788483250.321922:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087158016:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483250.321961:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087158016:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 39us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483250.321967:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 71 00000100:00100000:2.0:1788483250.321981:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 72 00000100:00100000:2.0:1788483250.321988:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087158528:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483250.322026:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087158528:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 38us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483250.322032:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 72 00000100:00100000:2.0:1788483250.322044:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 73 00000100:00100000:2.0:1788483250.322060:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+22:2393:x1875360087157888:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483250.322089:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+22:2393:x1875360087157888:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 39us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483250.322129:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 73 00000100:00100000:2.0:1788483250.322151:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158272 00000100:00100000:2.0:1788483250.322154:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158272 00000100:00100000:2.0:1788483250.322178:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158144 00000100:00100000:2.0:1788483250.322180:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158144 00000100:00100000:2.0:1788483250.322199:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:2.0:1788483250.322205:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087158272:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483250.322230:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087158272:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483250.322236:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:2.0:1788483250.322248:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:2.0:1788483250.322254:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087158144:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483250.322277:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087158144:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483250.322282:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:0.0:1788483250.322639:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.322672:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.322692:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483250.322793:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158656 00000100:00100000:0.0:1788483250.322798:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158656 00000100:00100000:0.0:1788483250.322828:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158784 00000100:00100000:0.0:1788483250.322831:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158784 00000100:00100000:0.0:1788483250.322850:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:0.0:1788483250.322856:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087158656:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483250.322910:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087158656:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483250.322917:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:0.0:1788483250.322939:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:0.0:1788483250.322946:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087158784:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483250.322969:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158400 00000100:00100000:0.0:1788483250.322977:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087158784:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 30us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483250.322986:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158400 00000100:00100000:0.0:1788483250.323001:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:3.0:1788483250.323067:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 74 00000100:00100000:3.0:1788483250.323090:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2393:x1875360087158400:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483250.323198:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2393:x1875360087158400:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 110us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483250.323206:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 74 00000100:00080000:1.0:1788483250.323323:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483250.323329:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483250.323331:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483250.323334:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788483250.489283:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483250.489471:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483251.517147:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483251.960310:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483251.960332:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c4d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098775168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483251.960396:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.960594:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775168 00000100:00100000:0.0:1788483251.960601:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775168 00000100:00100000:0.0:1788483251.960651:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483251.960662:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098775168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483251.960690:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788483251.960733:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098775168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.960740:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483251.960764:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098775424:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.960795:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.960821:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098775936:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.960845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.960873:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098776448:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.960897:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.960914:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788483251.960920:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098775296:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.960947:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.960967:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098775808:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.960989:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.961007:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098776320:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961030:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788483251.961067:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788483251.961081:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775424 00000100:00100000:0.0:1788483251.961085:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775424 00000100:00100000:0.0:1788483251.961146:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775808 00000100:00100000:0.0:1788483251.961149:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775808 00000100:00100000:0.0:1788483251.961163:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788483251.961169:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098775424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961206:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098775424:12345-0@lo:400:kworker.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.961213:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788483251.961225:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788483251.961231:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098775808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961258:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098775808:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.961264:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788483251.961281:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775936 00000100:00100000:0.0:1788483251.961284:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775936 00000100:00100000:0.0:1788483251.961309:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788483251.961315:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098775936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961343:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098775936:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.961349:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788483251.961366:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775296 00000100:00100000:0.0:1788483251.961369:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775296 00000100:00100000:0.0:1788483251.961392:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788483251.961398:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3620:x1875360098775296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961424:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3620:x1875360098775296:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.961439:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788483251.961474:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776448 00000100:00100000:0.0:1788483251.961478:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776448 00000100:00100000:0.0:1788483251.961500:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776320 00000100:00100000:0.0:1788483251.961503:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776320 00000100:00100000:0.0:1788483251.961518:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788483251.961524:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098776448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961553:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098776448:12345-0@lo:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.961559:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788483251.961570:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788483251.961576:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098776320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961602:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098776320:12345-0@lo:400:kworker.0 Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.961608:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788483251.961638:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098775296:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961651:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098775808:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961660:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098776320:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961669:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098775424:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961677:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098775936:0@lo:400:kworker.0 00010000:00080000:0.0:1788483251.961689:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69c59e5500 x1875360098776448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483251.961699:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098776448:0@lo:400:kworker.0 00000100:00080000:0.0:1788483251.961737:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483251.961740:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483251.961743:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483251.961755:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098775552:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.961798:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098776064:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961816:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.961828:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098776576:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961846:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.961878:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788483251.961883:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69efde9f80, transno 8589934596 00000004:00080000:0.0:1788483251.961891:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788483251.961910:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c4d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098775168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483251.961921:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788483251.961926:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098775680:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961948:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.961960:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098776192:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.961978:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.961989:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098776704:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.962005:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483251.962022:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776576 00000100:00100000:0.0:1788483251.962025:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776576 00000100:00100000:0.0:1788483251.962048:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775680 00000100:00100000:0.0:1788483251.962050:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775680 00000100:00100000:0.0:1788483251.962059:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776192 00000100:00100000:0.0:1788483251.962061:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776192 00000100:00100000:0.0:1788483251.962080:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776704 00000100:00100000:0.0:1788483251.962083:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776704 00000100:00100000:0.0:1788483251.962115:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788483251.962122:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098776576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.962155:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098776576:12345-0@lo:400:kworker.0 Request processed in 34us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.962161:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788483251.962173:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788483251.962179:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098775680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.962205:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098775680:12345-0@lo:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.962211:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788483251.962222:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788483251.962228:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098776192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.962255:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098776192:12345-0@lo:400:kworker.0 Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.962260:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788483251.962272:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788483251.962278:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098776704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.962302:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098776704:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483251.962307:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788483251.962321:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483251.962323:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483251.962338:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098775680:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.962346:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098776192:0@lo:400:kworker.0 00010000:00080000:0.0:1788483251.962365:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37fb480 x1875360098776704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483251.962374:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098776704:0@lo:400:kworker.0 00000100:00100000:0.0:1788483251.962384:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098776576:0@lo:400:kworker.0 00000100:00100000:2.0:1788483251.962539:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098775552 00000100:00100000:2.0:1788483251.962543:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098775552 00000100:00100000:2.0:1788483251.962571:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776064 00000100:00100000:2.0:1788483251.962580:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776064 00000100:00100000:2.0:1788483251.962604:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788483251.962610:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098775552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483251.962654:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098775552:12345-0@lo:400:kworker.0 Request processed in 44us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483251.962659:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788483251.962671:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483251.962676:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098776064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483251.962700:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098776064:12345-0@lo:400:kworker.0 Request processed in 24us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483251.962706:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788483251.962828:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483251.962831:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483251.962855:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098775552:0@lo:400:kworker.0 00000100:00100000:2.0:1788483251.962880:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098776064:0@lo:400:kworker.0 00000100:00100000:1.0:1788483251.962974:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098776832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483251.963006:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483251.963038:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776832 00000100:00100000:1.0:1788483251.963042:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776832 00000100:00100000:1.0:1788483251.963067:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483251.963073:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098776832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483251.963085:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483251.963140:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098776832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483251.963146:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483251.963177:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098776832:0@lo:13:osp-pre-1-1.0 Debug log: 43643 lines, 43643 kept, 0 dropped, 0 bad.